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¢ Introduction (Steve Zornetzer) 


Process, Mission Drivers, Deliverables, and Interfaces 
(James Crawford) 
Autonomy (James Crawford) 
— Crew-Centered and Remote Operations 
— Integrated Systems Health Management 
— Autonomous Vehicle Control 
— Autonomous Process Control 
Robotics (Paul Schenker) 
— Robotics for Solar System Exploration 
— Robotics for Lunar and Planetary Habitation 
— Robotics for In-Space Operations 


Computing Systems (Mike Lowry) 
Conclusion 


Capability Roadmap Teams 


Capability NASA chair External chair 


High-Energy Power and Propulsion Joe Nainiger (GRC) Dr. Tom Hughes (Penn State Uni.) 
In-Space Transportation Paul McConnaughey (MSFC) Col. Joe Boyles (US Air Force SMC) 


Advanced Telescopes and Lee Feinberg (GSFC) Dr. Howard MacEwen (SRS Technologies) 
Observatories 


Communication and Navigation Bob Spearing (HQ/SOMD) Michael |MichaelRegan(DoD) = ssisis—s—sidY (DoD) 


Robotic Access to Planetary Mark Adler (JPL) Dr. Robert Braun (Georgia Tech) 
Surfaces 


Human Planetary Landing Systems Robert Manning (JPL) Dr. Harrison Schmitt 
Human Health and Support Systems Dennis Grounds (JSC) Al Boehm (Ret, Hamilton-Sundstrand) 


Human Exploration Systems and Chris Culbert (JSC) Dr. Jeff Taylor (Uni. of Hawaii) 

Mobility 

Transformational Spaceport/Range Karen Poniatowski (HQ/SOMD) Gen. (Ret.) Jimmy Morrell 
Col. Dennis oe (OSD) 


Scientific Instruments/Sensors Rich Barney (GSFC) Dr. Maria Zuber |Dr.MariaZuber (MIT) 


In Situ Resource Utilization Jerry Sanders (JSC) Dr. Mike Duke 
(Colorado School of Mines) 
Advanced Modeling, Simulation, Dr. Erik Antonsson (JPL) Dr. Tamas Gombosi 
Analysis (Uni. Of Michigan) 
Systems Engineering Cost/Risk Steve Cavanaugh (LaRC) Dr. Alan Wilhite (Georgia Institute of Technology) 
Analysis 


Nanotechnology Dr. Murray Hirschbein (HQ/ARMD) Dr. Dimitris Lagoudas 


and (Texas A&M) 
Dr. Minoo Dastoor (HQ/ESMD) 
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Co-Chairs 

NASA: Steve Zornetzer, NASA/Ames Research Center 
External: Douglas Gage , DARPA (ret.) 

NASA Deputy: James Crawford , NASA/Ames Research Center 
NASA Deputy: Paul Schenker, JPL 


NASA Industry Academia 

Steve Chien, JPL Chris Leslie, USA Dave Akin, Univ. of Maryland 
Michael Lowry, ARC Dan Clancy, Google (ex-NASA) Red Whittaker, CMU 

Ron Diftler, JSC Additional reviews underway: Reid Simmons, CMU 

Dave Lavery, NASA HQ Barry Fox, Boeing Bob Full, UC Berkeley 

Ilan Nourbakhsh, ARC Kerry Fisherkeller, NG Brian Williams, MIT 

Julia Loftis, GSFC James Allen, IHMC 

Michel Ingham, JPL Michael Evangelist, CMU 


Serdar Uckun, ARC 


Coordinators 
Directorate: Harley Thronson, SMD 
APIO: Jan Aikins, ARC 
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The Autonomous Systems, Robotics, and Computing Systems 
(AR&C) capability roadmap details the information technology and 
robust hardware and computing technology required for NASA 
spacecraft, robots, and human/robotic teams to explore harsh 
dynamic environments safely and affordably. 


AR&C capabilities include: 


10.1 Autonomous Operations 10.5 Robotics for Solar System Exp. 

10.2 Integrated Systems 10.6 Robotics for Lunar and Planetary Hab. 
Health Management 10.7 Robotics for In-Space Operations 

10.3 Vehicle Control 10.8 Software Validation and Verification 

10.4 Process Control 10.9 Avionic Systems (incomplete) 


AR&C does NOT include (by charge from APIO): 

— Supercomputing 

— Data archiving and analysis 

— Computer networks and grid computing 

— Robotic hardware (except as required to develop and benchmark software) 


— Much of “classic” Computer Science — compilers, programming languages, 
databases, etc. (except in limited cases as driven by the capabilities above) 
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Driving Requirements 


¢« Exploration is a contact sport. To understand our universe 
and to search for life, NASA robots and spacecraft will be: 
— Onand under the surface of Mars, on cliffs and in caves 
— Onasteroids and taking samples on comets 
— On the surface and in the clouds of Venus 
— Under the clouds of Titan, and under the ice on Europa 


— On the moon searching for resources and preparing for a 
long-term human presence 


¢ NASA manned and unmanned missions will be carrying 
out mbInETe ay challenging tasks far from Earth: 
Habitat construction and long term habitation 
— _|In-space construction of spacecraft and observatories 
— Mining and in-situ resource utilization 
— Deep drilling (lunar, Mars, Europa, etc.) 


— Spacecraft constellations (interferometry, gravity wave 
detection, Earth-Sun connection, etc.) 


— Scientific laboratory tests currently done only on earth 
— Biological and habitability analysis 


These missions create pacing NASA challenges in in 
Autonomy, Robotics, and Computing 
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Capability Breakdown Structure 


Deputy: 
Deputy: 


Co-Chair: 
Co-Chair: 
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Steve Zornetzer, NASA/ARC 
Douglas Gage, DARPA (ret.) 
James Crawford, NASA/ARC 
Paul Schenker, JPL 


Tt _—__—_——__—. 
Crew-Centered Integrated Autonomous Autonomous Robotics for Robotics for Lunar Robotics for In- Computing 
eral (Eker Systems Health Vehicle Control Process Control Solar System and Planetary Space Systems 

Operations Management Exploration Habitation Operations 
10.1 10.2 10.3 10.4 10.5 10.6 10.7 10.8 
Chair: Julia Loftis Chair: Serdar Uckun Chair: Michel Chair: James Chair: Reid Chair: Illah Chair: Ron Diftler Chair: Mike Lowry 
| GSFC / ARC Ingham / JPL Crawford / ARC Simmons / CMU Nourbakhsh / ARC 1 JSC / ARC 
Co-Chair: Brian Co-Chair: Lorraine Co-Chair: Doug Co-Chair: Mike 
Williams / MIT Fesq / JPL Gage / DARPA (ret.) Evangelist / CMU 
Crew-Centered b Design of Health Rendezvous Life Support Mobility and Site Development Assembly Automated 
| Plannin Management and Dockin Access | | | Testin 
10.1.1 a Sane 103.4 9 10.4.1 ere 10.6.1 10.7.1 10.8.1°°.9 
Autonomous Orbit Insertion ISRU Process Instrument Site Maintenance Inspection Analytic 
|_| Mission a Control Deployment 7] Assurance 
Operations Real-Time 10.3.2 10.4.2 10.5.2 10.6.2 MOEA | 10.8.2 
10.1.2 System Health — 
Management =e i 
: g Entry, Descent, | Nuclear Grboard ISRU _| Maintenance _| Fault tolerance 
Multi-System 10.2.2 | =f and Landing Reactors Autonomous 10.6.3 10.7.3 10.8.3 
Coordination & 10.3.3 vee Science 
Collaboration | Informed 10.5.3 ; ‘ti 
10.1.3 Logistics ;-— Deep Drilling lel Eooleyes Human-Robot Certified, 
Launch A [reared a a Support Interaction automated SW 
10.2.3 —= Systems A. S oes i 
Human- 1a ‘4 10.4.4 Field’ Science 10.7.4 generation 
|_| Automation a ee 10.5.4 10.8.4 
Interaction Plug & Play Human-Robot = 
10.1.4 UAV Control — Controllers Interaction 
cm 10.4.5 Human-Robot RS) Maintainability 
Multi-Modal 10.3.5 Interaction GgReusabilty 
Interfaces for |_| Smart Systems 10.5.5 8. 
Collaborative 
A aden ——— 
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Introduction (Steve Zornetzer) 


Process, Mission Drivers, Deliverables, 
and Interfaces (James Crawford) 
Autonomy (James Crawford) 

— Crew-Centered and Remote Operations 

— Integrated Systems Health Management 

— Autonomous Vehicle Control 

— Autonomous Process Control 

Robotics (Paul Schenker) 

— Robotics for Solar System Exploration 

— Robotics for Lunar and Planetary Habitation 

— Robotics for In-Space Operations 


Computing Systems (Mike Lowry) 
Conclusion 
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. Roadmapping has been based on a series of workshops with 
presentations by experts on mission classes and by technologists, and 
a series of follow-up meetings between workshops (process detailed 
below). 


. The capability sub-teams have also studied the relevant NASA-level, 
directorate-level, and theme-level strategic plans (and other documents 
detailed below). 


. The primary output of the process is a set of deliverables 

— 5-8 per sub-capability 

— Each deliverable linked to one or more mission drivers 

—  Sub-Capability deliverables will be prioritized by the degree to which they 
enable missions and mission classes, and by the degree to which the 
enhance missions and mission classes (as measured increased science 
return and decreased cost). 

— This prioritization has been done only roughly since it requires further input 
from the Strategic Roadmaps. 
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Phevencee P 
¢« Autonomy, Robotics, and Computing requirements will be driven primarily by the following 
mission sets: 
— Exploration Mission Directorate 
° The Exploration Initiative Mission Spirals 
° Robotic Lunar Exploration (RLEP) 
— Science Mission Directorate 
° Mars Exploration 
° Solar System Exploration 
° Earth Science 
° Structure and Evolution, and Origins 
° Sun-Earth Connection 
— Aeronautics 
° High Altitude Long Endurance Remotely Operated Aircraft (HALE ROA) 
¢ Timelines for these mission classes will be available in April from the Strategic Roadmap 
Teams. For this package we have used available information and, where necessary, 
made assumptions about mission dates. 
¢ Roadmap deliverables are shown on the timeline ~5 years before mission launch. 
¢« NASA's investments will focus on NASA pacing challenges. NASA will avoid investing in 
capabilities that will be independently developed by industry. NASA will pursue 
partnerships with DARPA, and other federal agencies, where priorities align. 
¢ Since this is a strategic exercise (not program formulation), the following is out of scope: 
— Where R&D will be done (industry, academics, NASA centers) 
— How R&D will be managed to maximize mission impact (integration frameworks, partnerships, etc.) 
— Scope, budgets, and time lines for programs 
= Pre-decisional Draft = _ &D - 
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* Select and invite External Co-Chair ; . 
‘Collect team member recommendations + JPL mission briefings * Diverse range of inputs * In-Space Ops briefings 
from NASA academia and industry * SSE roadmap briefings * Problem statements * Def. of roadmap content 
*Select NASA and external team members * Briefings on JPL R&D * Summaries of state of the * Sub-team creation 
* Basic organization and art * Prelim. capability analysis 
processes * Briefings on JSC R&D 


*Roadmap Development Plan, Budget, and 
Schedule 
«Investigate Roadmap Overlap 


* Briefings on all major 
mission drivers 

* Briefings on GSFC R&D 
* Initial review of sub-team 
material 


*A Clear Pathway to Capability *Capability Priorities 
Development? *Sub Capability Roadmaps 
‘Technology Maturity Level? «Integration with Other 
*Metrics for measuring Roadmaps 

Technical Maturity 

Advancement? 

*Connection Points to Other 

Roadmaps? 


* Ames, JPL, and SMD 
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Mission Drivers 


Titan Aerobot 
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Mars Sample Astrobiology Field \ sarc 
Mars Science Lab Return Lab 


Taree | | 
BSE! smal 
Re _Dodies 


Et 


Europa cryobot 
and hydrobot 


Spiral 4-5 
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A science-driven effort to characterize and understand 
Mars as a dynamic system, including its present and 
past environment, climate cycles, geology, and 
biological potential. 


“Following the Water” 
This decade we set the context for the Search for Life 
as we characterize and understand Mars and its 
environments. 


“Following the Carbon” 
Towards the end of the decade, the search focus’ on 
“Following the Carbon’, the basic building blocks of 
life, and life itself. 


“Robots, to Human Precursors, to Humans” 
The knowledge and understanding being developed 
today paves the way... 
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Pathway Lines of Scientific Inquiry 


Search for Science from First Decade missions plus early next-decade missions confirms ancient Mars was 
Evidence of wet and warm 


Past Life - Locating and analyzing water-lain sedimentary rock is primary goal. 
¢ Pathway includes search for evidence of past life. 


Explore Exploration in First Decade discovers hydrothermal deposits (active or fossil) 
Hydrothermal * Probability of hydrothermal regions being discovered is potentially high. 
Habitats ¢ Hydrothermal habitats are focus of second decade of Mars exploration. 
* Potential for discovery of evidence of past and present life is greatly improved. 
Search for Commits to search for present life at sites determined to be modern habitats by First Decade 
Present Life missions 
¢ Search for life at active hydrothermal deposits or polar margins. 


¢ Path would be taken only following a discovery that revolutionizes our understanding of the 
potential of Mars to harbor present life. 


¢ MSR with mobility is included as the most reliable, validatible means of detecting life. 


Explore Science of First Decade of Mars exploration does not find evidence of past or present liquid water 
Evolution of environments 


Mars * Determine the loss mechanisms and sinks for water and CO, over time. 
¢ Determine why the terrestrial planets evolved differently, much more so than we had 
thought. 
¢ Determining whether the initial conditions on Venus, Earth and Mars were similar or very 
different. 
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Undertake robotic and human exploration of the 7. 
Moon to further science and to enable sustained 

human and robotic exploration of Mars and other 
destinations. (Agency Objective 4) 


Conduct robotic exploration of Mars to search for 
evidence of life, to understand the history of the 
solar system, and to prepare for future human 
exploration. (Obj 5) 


Conduct human expeditions to Mars after 
acquiring adequate knowledge about the planet 
using robotic missions, and after successfully 
demonstrating sustained human exploration 
missions to the Moon. (Obj 6) 


Conduct robotic exploration across the solar system 
to search for evidence of life, to understand the 
history of the solar system, to search for resources, 
and to support human exploration. (Obj 7) 


Search for Earth-like planets and habitable 
environments around other stars. (Obj 8) 


Develop a new crew exploration vehicle to provide 12. 


crew transportation for missions beyond low Earth 
orbit. (Obj 10) 


Focus research and use of the International Space 
Station on supporting space exploration goals, with 


emphasis on understanding how the space 13. 


environment affects human health and capabilities, 
and developing countermeasures. (Obj 12) 


Mars Robotic and 
Human Exploration 


TH. 


Return the Space Shuttle to flight, complete 
assembly of the International Space Station, and 
transition from the Space Shuttle to a new 
exploration-focused transportation system. (Obj 11) 


Explore our Universe to understand its origin, 
structure, evolution, and destiny. (Obj 9) 


Requirements 


Provide advanced aeronautical technologies to 
meet the challenges of next-generation systems in 
aviation, for civilian and scientific purposes, in our 
atmosphere and in the atmospheres of other 
worlds. (Obj 3) 


Use NASA missions and other activities to inspire 
and motivate the nation’s students and teachers, to 
engage and educate the public, and to advance the 
scientific and technological capabilities of the 
nation. (Obj 14) 


Develop a comprehensive national plan for 
utilization of nuclear systems for the advancement 
of space science and exploration. (No Agency Obj) 
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This Decade’s Discoveries Leads to the Next 


Decade’s Pathway 
2UnC. ear 


OPERATIONAL yAU ths) VAULUY A 2009 im) (->.4 mm DJ =Yor-[e (= 


a | P _ <—_/ 


| SiG 4 7, 


a5 a ! ~ 
Lys Sag ESA : i Explore the 
| Mars Express . Mars Telesat W Evolution of Mars 
Mars Global Surveyor La 


Mars 
: PS ) Reconnaissance 
: Orbiter 
(Italian SHARAD) 


Mars Odyssey ; : Search for — 
Evidence of Past Life 


Science pathways 
responsive to discovery 


Search for Present Life 
Competed Scout Mission a SS 
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Mars 


Exploration Phoenix Mars Science 
—— = Rovers Laboratory 
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..and Potential Pathway Mission Sequences 
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; Missions to high- 
aca robability past 
Search for Evidence] MSL to Field Lab te are 
’ : Scout MSR Scout habitat. Mission in ‘18 
of Past Life Moderate Latitude or 
; influenced by MSL 
Deep Drill 
results. 

Explore MSL to Astrobiology All core missions sent 

Hydrothermal Hydrothermal Field Scout Deep Drill to active or extinct 
Habitats Deposit Laboratory hydrothermal deposits. 


cites Baeatat MSL to High Missions to modern 
Life Latitude or Active] Scout Scout MSR Scout : habitat. Path has 
Vent highest risk. 

; Path rests on proof 

Explore Evolution of MSL to 
; Network t | that Mar. never 
wet. 
2005 President's st Mars Mars 

Budget Augmentation Testbed Testbed Testbed 


Replacement 
Telecom* 


_Note: The a followed will depend on knowledge and technologies developed this decade. _ 
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S “Search for Past Life” Pathway Example 
2009 2011 2013 2016 2018 
“i __ 


Mars Telesat Orbiter MRO 2 Telesat 
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Candidate Solar System Exploration Missions 
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2010 2015 2020 
— Prometheus Neptune 
Cc 
nave ints Enabled Triton 
Missions Orbital 
Tour 
New Frontiers Candidates New Frontiers Candidates New Frontiers 
Geophysic Cc : 
ryogenic 

al Network sample 


or rover 


Moonrise Juno Venus SAGE return 


Discovery Comet Clipper 
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identify Key 
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oe 
Key 


y % Planned Robotic Mission 


© Potential Robotic Mission/Decision” 


Ga Robotic Operations 
y % Planned Human Mission 


oe: Potential Human Mission/Decision* 


© Human Operations 


* Earliest estimated date 


Rn 


Trailblazers 


2010 


Hu 


| 
man Missions 
to the Moon 


SS Sd Mum 


Go 


Beyond 


Mars 


Outer Moons 


Extrasolar 
Planets 


Building 
Blocks 


Constellation Spirals 
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ESRT: Exploration Systems Research & Technology 
PNST: Prometheus Nuclear Systems Technology 
HRST: Human System Research & Technology 
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Spirals Definition 


Spiral 1: 4-6 crew to Low Earth Orbit (2014) 
— Crew Exploration Vehicle (CEV) 
° Launch environment 
o LEO environment 
o Earth entry, water (or land) recovery 
Spiral 2: 4-6 crew to lunar surface for extended-duration stay (2015-2020) 
— Crew Exploration Vehicle (CEV) 
o Earth-moon cruise - 4 days 
o Low lunar orbit (LLO) operations — 1 day 
° Untended Lunar Orbit operations — 4-14 days 
° Low lunar orbit operations — 1 day 
° Moon-Earth cruise — 4 days 
— Lunar Lander 
° Surface operations with EVA 4-14 days 
Spiral 3: 4-6 crew to lunar surface for long-duration stay (2020-TBD) 
— Lunar habitat 
o Lunar surface operations 60-90 days 
Spiral 4: Crew to Mars vicinity (2025+) 
— Transit vehicle 
° Earth-Mars cruise — 6-9 months 
° Mars vicinity operations — 30-90 days 
° Mars-Earth cruise — 9-12 months 
Spiral 5: Crew to Mars surface (2030+) 
— Surface habitat and exploration 
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AR&C is heavily cross-cutting. Most capabilities are relevant to multiple 
missions and mission classes. For purposes of the roadmap we have listed the 
first major driver. 


In many cases AR&C is providing control and execution software for hardware 
developed by other capability roadmaps (e.g., drilling, EDL, nuclear reactors, life 
support, etc.). Conversations with these capability roadmap teams have begun 
and will increase once all teams have full packages. 


Numerous AR&C capabilities have applications in superficially very different 
missions (e.g., control and execution software shared between rovers, drilling, 
life support, and interferometry). Such sharing can reduce costs, shorten 
schedules, and reduce risks. This is an important lesson of agency-level 
analysis. 


Common themes: 
iP Communication latencies create pacing NASA challenges 


2. Surface exploration drives autonomy and robotics 
3. The other driver is challenging manipulative tasks (construction, drilling, ISRU, 


constellations, science experiments, etc.) 
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Driving 
Missions 


AR&C 
Capabilities 


10.1 Crew-Centered and 
Remote Operations 


10.2 Integrated System 
Health Management 


10.3 Autonomous Vehicle 
Control 


10.4 Autonomous Process 
Control 


10.5 Robotics for Solar 
System Exploration 


10.6 Robotics for Lunar 
and Planetary Hab. 


10.7 Robotics for In- 
Space Operation 


10.8 Computing 
Systems 
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Systems: 


Mars 
Exploration Phoenix 
Rovers 


Various 
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A A 


A Major Event / Accomplishment / Milestone 


Science 
Laboratory 
A 


Mixed- Mixed- 
Initiative Initiative 
Activity Activity Traverse 


Planning Planning & instr, 


(2012) 
LISA 


Multi- 
Platform 


Collab. & Lannche eo Long 
Control Rendezvous : 
& Docking : 


Enhancing/ 
Evolutionary 


Lunar ae 
_ Sample * 
Return : 


: In Space : 
Per K  : Inspection: 


: Testbed / 
H A : 


(2014) 
Spiral 1 
A 
5 Mars 4 


Human 
Robot 


Ready to Use 
(TRL 6) 


Spiral 2 


— Recert. 
? Cost < $1K 
; ‘Interaction: 
: Robotics i 
:& control : Cause : 
:forISRU__ : Analysis: 


De stave Robotics and Comautma a a 
Autonomous Systems, Robotics, 


and Computing [ ( 
‘Mh 


MER Capabilities (10.1) 


MER science and uplink team 
= ae members have estimated that overall 
= = —_ science return increased by 20 to 50%. 


———- See 
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MAPGEN: Activity plan 


development and analysis 


Viz: High fidelity terrain 
modeling and analysis 


CIP: Customizable data navigation, ~s 
search, and information management HCC & Fatigue 
Countermeasures: Improved data 
MERBoard: Collaborative understanding and Enhanced 
information analysis and sharing situational awareness 
aes redid haa § §_§_;_;_<_K_[—GF[[=—[—EOE=—EOEe eee 
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Description Pl/Technologist 
Long Range Science NASA (Code R and MTP) {Provides increased traverse range of rover operations, improved traverse acuracy, landerless |Samad Hayati 
Fee Sail |e eee and distributed ground operations with a large reduction in mass Richard Volpe 
Science Activity Planner |NASA (Code R and MTP)/|Provides downlink data visualization, science activity planning, merging of science plans from |Paul Backes 
oe ee eae multiple scientists Jeff Norris 

FIDO: Field Integrated NASA (MTP) Developed TRL 4-6 rover system designs, advancing NASA capabilities for Mars exploration; |Paul Schenker 
Design and Operations demonstrated this in full-scale terrestrial field trials, Integrated/operated miniaturized science |Eric Baumgartnel 
Rover payloads of mission interest, coupling terrestrial field trials to 


Manipulator Collision NASA (MTP) Computationally efficient algorithm for predicting and preventing collisions between manipulator} Eric Baumgartner 
Prevention Software and rover/terrain. Chris Leger 


Descent Image Motion NASA (Code R and MTP) |Software and hardware system for measuring horizontal velocity during descent, Algorithm Andrew Johnson 
Estimation System combines image feature correlation with gyroscope attitude and radar altitude measurements. |Yang Cheng 
(DIMES) et al. 


Parallel Telemetry NASA (Code R and MTP) |Data cataloging system from PTeP is used in the MER mission to catalog database files for |Mark Powell 

Processor (PTeP) the Science Activity Planner science operations tool Paul Backes 

Visual Odometry NASA (MTP) Onboard rover motion estimation by feature tracking with stereo imagery, enables rover motion |Larry Matthies 
estimation with error < 2% of distance traveled Yang Cheng 


Rover Localization and NASA (MTP) An image network is formed by finding correspondences within and between stereo image Ron Li 
Mapping pairs, then bundle adjustment (a geometrical optimization technique) is used to determine Clark Olson 
camera and landmark positions, resulting in localization accuracy good for trav et. al. 


Grid-based Estimation of INASA (Code R and MTP) |Performs traversability analysis on 3-D range data to predict vehicle safety at all nearby Mark Maimone 
Surface Traversability locations; robust to partial sensor data and imprecise position estimation. Configurable for 


Applied to Local Terrain avoiding obstacle during long traverse or for driving toward rocks for 
(GESTALT) 
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Systems: Capability Roadmap 


(2018) 

SAFIR Prometheus Spiral 3 Titan Aerobot Planet Imager 

. x Aah A Europa Cryobot 
a Comet Sample : Spirais4a5 4 

Return : A : 


Driving 
Missions 


: Venus Aerobot - 


: 
. 


Mars Deep Drill : Mars Airplane 


. \ i : In Space Z 
In Space UAV Crew: : : 

0 d : Safe Assembl : 

g Connection : Aut. Centered :_ °° ~ ; embly =: Robust 
Os P Process : Mission :/impoint Aerial Small : Enhancements Aut. & 
SS rocess = Control for : | EDL Survey & : f 
= o Controlfor Nuclear : ops.:  : 5 ; Body Of all Fault 

s Drilling Reactors. : Prognostics "*™P'NS EDL :  Spirall-3 Recovery 


Capabilities 
10.1 Crew-Centered and 


Remote Operations 


10.2 Integrated System 
Health Management 


10.3 Autonomous Vehicle 
Control 


10.4 Autonomous Process a 


Control 


10.5 Robotics for Solar a 


System Exploration 


10.6 Robotics for Lunar a 


and Planetary Hab. 
10.7 Robotics for In- re ee. Les 
Space Operation 


10.8 Computing 
Systems 


Enhancing/ Ready to Use 


© Major Decision A Major Event / Accomplishment / Milestone Evolutionary (TRL 6) 
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Mars SolarSys.Lunar Obs. Earth Sci. Sun-Earth Spiral 1 Spiral 2 Spiral 3 


10.1 Autonomous mission ops 
10.1 Multi-platform collaboration 
10.2 Root-cause analysis 

10.2 Prognostics 

10.3 Rendezvous and Docking 
10.3 Entry, descent, & landing 
10.4 Nuclear reactor control 
10.4 Sub-surface drilling 

10.5 Long traverse 

10.5 Aerial survey and sampling 
10.6 Human-robot interaction 
10.6 ISRU 

10.7 In-space inspection 

10.7 In-space connecting 

10.8 <.1 defect per K SLOC 


a 
10.8 Recert.<$1K perk SLOC |} 


SMD 


Notes: 

¢ Spiral 4 is similar to spiral 3. 

¢ In most case AR&C is developing software to control 
hardware developed by other capabilities. 
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ca First [| Enabling 


driver 


[ Enhancing 
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Breakthrough Capability Rollup : é, 


Capability 


Autonomy and control for deep drilling 
(10.4, 10.3, 10.5, and 10.2) 


Dependable, and affordable robotic in- 
orbit maintenance (10.7 and 10.3) 


Dependable and affordable robotic in- 
orbit assembly (10.7 and 10.3) 


Dependable autonomy for aerobots 
and sub-surface (10.4, 10.1, and 10.5) 


Surface mobility to cliffs and other 
current inaccessible sites (10.5). 


Largely automated CEV and habitat 
operations (10.1 and 10.2) 


Autonomous robotic surface 
construction and ISRU (10.6 and 10.4). 
ooo pinpoint landing 
10.3). 
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Enables 


Sub-surface search for evidence of 
life on Mars and Europa 


Instrument change-out and long 
term operation of observatories 


Large aperture telescopes, 
affordable human exploration 
beyond earth-moon neighborhood. 


Aerial Mars survey. Surface access 
on Titan. Search for evidence of 
life on Europa. 


Search for evidence of life on Mars 
in areas showing possible recent 
fluid flow 


Human exploration of Mars. 


Affordable human habitation on 
Moon and Mars. Robotic site 
preparation in advance of manned 
surface missions 


asa Exploration/Science Traceability 
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¢ AR&C requirements can be traced back to the following documentation: 


— Major recent vision documents: 
°o “The Vision for Space Exploration”, 2004, (Doc NP-2004-01-334-HQ) 
°0 “Exploration Systems Interim Strategy”, 2004 
°0 “A Journey to Inspire, Innovate, and Discover”, President’s Commission Report 
“The New Age of Exploration: NASA's Direction for 2005 and Beyond” 
— NASA Enterprise Strategy Documents 


° “The Future of Solar System Exploration, 2003-2013”, NRC Planetary Decadal Report, 
2002 


° “Assessment of Mars Science and Mission Priorities”, National Research Council, 2003 


° “Scientific Goals, Objectives, Investigations, and Priorities” - MEPAG report on priorities 
for Mars exploration 


°0 “Mars Exploration Strategy”, Mars Science Program Synthesis Group, 2003 
°o Solar System Exploration Roadmap, 2003, (Doc JPL 400-1077 5/03) 
— Design Reference Missions 


o Lunar Surface Reference Missions: A Description of Human and Robotic Surface Activities 
(NASA/TP 2003-212053) 


° The Mars Surface Reference Missions: A Description of Human and Robotic Surface 
Activities (NASA/TP 2001-209271) 


° Solar System <update from Cutts> 


— ESMD preliminary requirements documents: ESS Technology Requirements RevB, 
CTS Spirals 1-3 RevB, RLEP Requirements (Sept 04), CEV ConOps (Sept ’04) 


¢ Sub-team materials include tracing from each deliverable to the first driving mission 
(and our assumptions about the timing of that mission) 
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| Leveraging non-NASA Robotic Developments ¢ 


| Piumse ne ; 


¢ Other players 
— DOD, DOE: well-defined relevant development thrusts (next slides) 
— Industrial: principally manipulators (pick and place, painting, etc) 
— Commercial/consumer: hard to predict, especially the future 
° Roomba vacuum, Aibo dog 
— Diversity of national focus 
o USA: UAVs, UGVs, military 
o Japan: humanoids, care for aging ("silver society") 
° Korea: robotic workers 
¢ Commonality of technologies limited by diversity of applications 
— Perception, navigation, behaviors, planning, HRI 
— Different tasks, environments require different knowledge bases 
o Sensors, effectors must be appropriate to each application 
o May require qualitatively different software approaches 
¢ Space-based computational resources extremely limited 


— Need for rad-hard operation precludes effective exploitation of 
Moore's law price/performance gains 
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DoD Robotics/UXV Service Thrust Areas 
— Army: Future Combat System (FCS): UGVs, UAVs, crew enhancement 
— Navy: UUVs, UAVs 
— Air Force: UAVs 
DARPA Office Robotics-related Themes 
— TTO: UGVs & UAVs (system level), innovative mobility 
— IPTO: software (perception, behavior, learning, HRI) 
— DSO: biological inspired approaches 
— MTO: sensors, actuators, "micro-robots" 
— IXO: sensor systems 
ATO: ad hoc communications networks 
DARPA Grand Challenge 


— On-road/trail, following dense GPS waypoints, with perception-based corrections 
for obstacle negotiation 


— Has successfully generated awareness, enthusiasm, and constituency for 
attacking the autonomous UGV navigation problem 


NASA Participation in IPTO MARS Program 
— Mobile Autonomous Robot Software (1999-2004) 


— JSC (R. Ambrose): perception-based autonomous manipulation and mobility base 
for Robonaut 


— JPL (L. Matthies): perception for UGV navigation 
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Requirements 
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Robot Physical Light, Mass & Volume Sturdier; Re-Usable; Sturdier; Re-Usable; 
Characteristics Constrained Can Resist Wear and Can Resist Wear and 
Tear Tear 


Robot Environment Unexplored Terrain; Earth Terrain; On-Road | Radiation Rich Sites 
Extreme Cold/Heat & Off-Road 

Distance from Control Up to Millions of Few Kilometers Up to 1 Kilometer 

and Command Station Kilometers 


Robot Level of Autonomy | Semi-Autonomous Teleoperation/Semi- Teleoperation/Semi- 
(long time-delay) Autonomous (short Autonomous (short 
time delay) time delay) 


Robot Manipulators Pick-Up and Handle Lift and Handle Heavy Lift and Handle Heavy 
Small Objects (e.g. Loads Loads 
rocks); Low-Gravity 
Manipulation of 
Human-Made Objects 


Robot Vision Discover Interesting Detect & Track Human Inspect Hazardous 
Science Samples; Objects (walking Sites; Cluttered 
Detect Natural Hazards | soldier; moving lead Environment 
vehicle) 


~ 33° 
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¢ NASA is well aware of non-NASA efforts 
— Some joint work with non-NASA sponsors 


¢ Commonalities in technology needs are limited by: 

— Differences in application requirements 
° Differences in environments (e.g., no vegetation) 
o Differences in tasks to be performed 

— Differences in resources available 
° Communications latency and bandwidth 
o Limited opportunity to exploit human support 
o Limited computing power and memory due to rad-hard requirement 


¢ Bottom Line: we can't wait for someone else to do what we need 
to have done 
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Capability Roadmap Crosswalk 


Capability Roadmap Crosswalk Status to Date 
propulsion 
j.rmspacetanspotaton __|Resuisinnporaed, 
3. In-space transportation Results incorporated. 
face lenemectemt 
observatories Exchange of material. 


surfaces materials and multiple ongoing discussions. 
feos lovscussinswithisam. Atondanestworkshop.—_ 
systems Discussions with team. Attendance at workshop. 
one pitalaiscisionswintads. 
systems Initial discussions with leads. 
a 
and mobility Close working relationship with lead. 
fpacopovtangeteemongies | 
spaceport/range technologies 


12. Sensors and instruments Minimal discussions. Have draft of material. 


SS ee Sa a 
14. Advanced modeling, 
simulation, analysis 

eae 


13. In situ resource utilization 


cost/risk analysis 
16. Nanotechnology 


Limited relationship (or relationship at sub-capability level) 
Critical Relationship 
Moderate Relationship 
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Strategic Roadmap Crosswalk 
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Strategic Roadmap Crosswalk Status to Date 


a 
Exploration Jim Waitzin presentation at workshop. 
Ema entampegnegiaeperm 
Exploration Dave Lavery representing Mars program. 


Design Reference Missions and strategic guidance 
documentation. Discussions with Jim Cutts and Scott 


3. Solar System Exploration Hubbard. 


Design Reference Missions and strategic guidance 
4. Search for Earth-Like Planets |documentation. 


7.Space Shuttle 
Design Reference Missions and strategic guidance 
documentation. 


from Space documentation. 
einsisSeomtuialnene | 
10. Sun-Solar System Connection | documentation. 


11.AeronauticalTechnologies | 
12. Education ee 


13. Nuclear Systems 


Limited Relationship 

Critical Relationship 

Moderate Relationship 
Pre-decisional Draft 
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Nasal Capability Readiness Levels Sy 4 
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Capability Operational Readiness 


Integrated Capability Demonstrated in an 
Operational Environment 


Integrated Capability Demonstrated in a 
Relevant Environment 


Integrated Capability Demonstrated in a 
Laboratory Environment 


Sub-Capabilities* Demonstrated in a 
Relevant Environment 


Sub-Capabilities* Demonstrated in a 
Laboratory Environment 


Concept of Use Defined, Capability, Constituent 
Sub-capabilities* and Requirements Specified 


ee reed a akK>K_ 
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asa The Four Questions (again) ps , 
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1. Do the Capability Roadmaps provide a clear 
pathway to (or process for) technology and 
capability development? 


2. Are technology maturity levels accurately 
conveyed and used? 


3. Are proper metrics for measuring advancement 
of technical maturity included? 


4. Do the Capability Roadmaps have connection 
points to each other when appropriate? 
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Introduction (Steve Zornetzer) 


Process, Mission Drivers, Deliverables, and Interfaces (James 
Crawford) 


Autonomy (James Crawford) 

— Crew-Centered and Remote Operations 
— Integrated Systems Health Management 
— Autonomous Vehicle Control 


— Autonomous Process Control 
Robotics (Paul Schenker) 


— Robotics for Solar System Exploration 
— Robotics for Lunar and Planetary Habitation 
— Robotics for In-Space Operations 


Computing Systems (Mike Lowry) 
Conclusion 


Pre-decisinndl rat SaaS 


S Autonomous Systems — 10.1-10.4 V4 


10.1 Crew- 
Centered 

and Remote 
Operations 


10.4 Autonomous | 
Process 
Control 


02 Amie 
Oa Vehicle 
Ss. Control 


Granularity 
Sub-System System System-of-System 


Component 


milli-Seconds Seconds Minutes Hours Days Weeks 


Command frequency 
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Capability 10.1 
Crew-Centered and Autonomous Operations 


Sub-Team Chair: Julia Loftis, NASA/GSFC 
Presenter: James Crawford, NASA/ARC 
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Crew-Centered and Autonomous Operations 


Capability 10.1 
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This capability area defines the evolution of command and control 
for both manned and unmanned science and exploration missions. 
This includes: 


Crew-Centered Planning (activity sequences created by crew rather than 
ground personnel) 


Autonomous Mission Operations 


° 


O° 
fo} 
O° 
ie) 


Health and Safety Monitoring, Analysis and Anomaly Recovery 
Science Analysis and Optimization 

Dynamic Planning 

Onboard Robust Execution 

Logistics and Inventory 


Multi-system Coordination and Collaboration 


Human Automation Interaction 


Multi-modal Interfaces for Collaborative Execution 
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Crew-Centered and Autonomous Operations 
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¢ Crew-centered operation is enabling for Martian 
exploration due to both the latency of light speed 
communication, and the potential loss of 
communication. 


¢ Autonomous operation is enabling for some classes 
of planetary surface exploration and remote in-situ 
science. 


¢ Additional benefits 
— Reduced operations costs 


— Ability to react to unforeseen circumstances without reliance 
on ground ~ increased safety 


— Ability to take advantage of schedule gaps > increased 
efficiency 


asa Summary Status for Capability 10.1 Crew- J } ) 


Centered and Autonomous Operations 
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¢ Operation of crewed missions (Station and Shuttle) is presently a 
manually intensive process: 

— Station flight controllers uplink ~500,000 individual commands per year to fly 
and maintain the craft 

— Ateam of 50 Station mission planners manually develops a timeline for each 
crew member, which takes 2 weeks for each day’s activities; safety and 
feasibility constraint checking is not automated, but is handled through the 
knowledge of these experts 

— The Russians (who do not have constant communication via TDRSS as we 
do) upload some automated procedures. 


¢ Operation of unmanned vehicles is done via ground based sequence 
generation with some low level task automation and automated 
constraint checking; onboard automated safety procedures are routinely 
implemented 


¢ The state of the art in this area includes technology demonstrations for 
autonomous operation 


— EO-1 (03-05): technology demonstration of autonomous tracking of science 
events, onboard mission planning, smart task execution, and model-based 


diagnosis; autonomous formation maneuver planning and execution 


— DS-1 (99): technology experiment demonstrating autonomous planning, 
diagnosis, and execution 
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Detailed Status for Capability 10.1 Crew- 
Centered and Autonomous Operations 
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¢ Crew Centered Planning 
— Constraint-based activity planning (MER) 


— Ground-based automated scheduling (Shuttle ground 
processing) 


¢ Autonomous Mission Operations 
— Health and Safety Monitoring, Analysis & Anomaly Recovery 
0 NASA: largely manual (except critical onboard sequences) 
° Fail-operational autonomous on-board control (DS-1) 
° On-board model-based diagnosis (EO-1/DS-1) 
° DOD/DARPA? External? (JSF,777) 
Science Analysis and Optimization 
° Autonomous tracking and reaction to science events (EO-1) 
Dynamic Planning 
° DS-1 and EO-1 technology demonstrations cited above 
0 MER (MAPGEN ground planner) 
Onboard Robust Execution 
0 DS-1/ESL, EO-1/SCL 
° Terrestrial robotic demonstrations (LITA, PSA, K-9) 
Logistics and Inventory 
0 NASA: time-consuming, manual process to maintain database 
o External: barcode, RFID (powered & passive) 
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Centered and Autonomous Operations 
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¢ Multi-platform Coordination and Collaboration 
— “String of pearls” constellation control (Terra,Aqua,Aura,EO-1) 


— Technology demonstration of cooperation between two spacecraft: leading 
spacecraft perceives a phenomena and trailing spacecraft reacts to it. (EO-1) 


¢ Human Automation Interaction 


— Tele-operation with sequential command, execution; during execution, some 
subtasks (such as alignment) are automated 


— Mixed initiative activity planning used for MER (MAPGEN) 


¢ Multi-modal Interfaces for Collaborative Execution 
— In-situ Crew Training 


o Written procedure list; simple assistance for problem diagnosis 
° Task demonstration as human simulation 
° Free-Flying Mobile Robot with LCD/Pointer/Sensors (PSA) 
— EVA Support 
° Basic informational displays within helmet 
o AERCam in testing 
— Voice-based intelligent procedure access (Clarissa) 
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¢ Human Automation Interaction: Rapid Situational Awareness, Data 
Analysis, and Decision Support Tools 
— ESMD: Spiral 1: TRL 6 by 2009 


¢ Crew Centered Planning: Distributed, Constraint-based, Mixed-initiative, 
Mission Ops Planning Tools 
— ESMD: Spiral 2: TRL 6 by 2010 


¢ Multi-modal Interfaces for Collaborative Execution (e.g., voice for EVA) 
— ESMD: Spiral 2: TRL 6 by 2010 


¢ Multi-platform Coordination and Collaboration 
— SMD: LISA-3, MMS-4, GEC-4, MagCon-50 2012-2014, Stellar Imager-25 2015, 
Black Hole Imager Pathfinder-several 2018, Earth Science Sensor Web 
— ESMD: Spiral 2: TRL 6 by 2010 


¢ Autonomous Mission Operations: Health and Safety Monitoring, Analysis & 
Anomaly Recovery; Science Analysis and Optimization; Dynamic Planning; 
Logistics and Inventory 
— SMD: MSL 2009, MSR 2013, Earth Science Sensor Web, Titan / Europa missions 
(weeks out of contact), LISA 2012 
— ESMD: Spiral 3: TRL 6 by 2015 
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Driving 
Missions 


AR&C 
Capabilities 


10.1.1 


10.1.2 


10.1.3 


10.1.4 


10.1.5 


Autonomous Systems, Robotics, and Computing 
Systems: Capability Roadmap ‘ 


Mars Global Earth Obse 


(2009) (2011) (2012) ConX Sample System; Accurate Pred 
Lunar JWST LISA (2014) Return 4 Spiral 2 
Recon Lunar (2014) 4 : Mars 4 
Orbiter A Sample Spiral 1 | ‘Astrobiology 

A i: Field Lab : 


A E Return 


Science 


Subst cien Constellation : Driven : Centered 
Centered ‘Autonom Hae 
; Control Crew: 4 ¥ Planning 
Centeréd : Médel Driven 


Planing 


Planning Sensor Web 


Gisw Caniesd Plannin Distributed, Mixed- : d 
peers 9 Initiative Planning Tools Spiral Zn 


Spiral 1 
Planning Ops Con 


Planning Ops Con 


Sarhple Selection i 


Autonomous Mission Ops CRL7 i 
Multi-System Coordination — tT .1 
and Collaboration cee : Model Driven 

: Sensor Web 
Human Automation CRL7 Situational Awareness, A 


Decision Support 


Interaction 


Multi-modal Interfaces for §©§ —————__$_$?_?__>#oag 


CRL 7 


Collaborative Execution 


© Major Decision A Major Event / Accomplishment / Milestone Enhancing/ : Ready to Use — — 
Evolutionary : — 


Autonomous Systems, Robotics, and Computing 
Systems: Capability Roadmap ‘lh 


Stellar 

Mag Constellation ; Imager 
Spiral 3 Titan Aerobot 4 Planet Imager 
TPF A 
Mars Airplane 


Europa Cryobot 


Driving 
Missions 


4 Comet:Sample = Spiral 4 


Venus Aerobot Return 


Mars Deep Drill 


Formation Autonomous Formation Formation 
Flying, Human ; Flying Flying 
Fleet Support Autonomy for 
Management Systems Long Duration : Human Support Long Duration 
Autonomy Systems Autonomy 


AR&C 
Capabilities 


10.1.1 Crew Centered Planning 
Spiral 4 & 
Europa Ops Con 


Spiral 3 & 


Long duration system health Long duration without contact, 4 Long duration 
for ae health and safety science eomniced, ang aunty handling without contact 


10.1.3 Multi-System Coordination Freeflyer 


d-Celleborat Formation flying. 
and VOlaporalion Fleet management formation 


: : 
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10.1.2 Autonomous Mission Ops 


10.1.4 Human Automation 
Interaction 


10.1.5 Multi-modal Interfaces for —_ TT _Arv—_ A? Vv i 


Collaborative Execution CRL 7 


Enhancing/ | 


© Major Decision A Major Event / Accomplishment / Milestone ; Ready to Use 
© Evolutionary 
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¢ Human Automation Interaction: Rapid Situational Awareness, 
Data Analysis, and Decision Support Tools 
¢ ESMD Driver: Spiral 1, CEV (2014) 


— TRL 6 date: 2009 
— Interfaces: HESM 
— Decision points: Technology demonstrations 


¢ Crew Centered Planning: Distributed, Constraint-based, Mixed- 
initiative, Mission Ops Planning Tools 
¢ ESMD Driver: Spiral 2, lunar surface habitat (2015) 


— TRL 6 date: 2010 
— Interfaces: HESM 
— Decision points: Technology demonstrations in spirals 1 & 2 
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Deliverables for Capability 10.1 Crew- J p ] 


Centered and Autonomous Operations 
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Multi-modal Interfaces for Collaborative Execution: Voice interfaces 
between flight crew and automated tools and robots, mixed GUI-voice 
interfaces for ground crew. (Some risk) 


ESMD Driver: Spiral 2, surface ops with EVA (2015) 

TRL 6 date: 2010 

Interfaces: HESM, HHS 

Decision points: Technology demonstrations in spirals 1 & 2 


Multi-platform Coordination and Collaboration: Command and control for 
coordinated observation, sensor web, interferometery, etc. 


ESMD Driver: Spiral 2, CEV and Lunar Lander (2015) 

SMD Drivers: LISA-3 (2012), MMS-4 (2012), GEC-4 (2014), MagCon-50 
(2013), Stellar Imager-25 2015, Black Hole Imager Pathfinder-several (2018), 
Earth Science Sensor Web 

TRL 6 date: 2007 

Interfaces: HESM. SIS, ATO 

Decision points: Technology demonstrations in spirals 1 & 2 
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Deliverables for Capability 10.1 Crew- 
Centered and Autonomous Operations 
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¢ Autonomous Mission Operations: Health and Safety Monitoring, 
Analysis & Anomaly Recovery; Science Analysis and 
Optimization; Dynamic Planning; Logistics and Inventory 
— ESMD Driver: Spiral 3, lunar surface habitat (2020) 


— SMD Drivers: MSR sample selection (2013), Earth Science Sensor 
Web, Titan / Europa missions (weeks out of contact), LISA (2012) 


— TRL6 date: 2004 
— Interfaces: HESM, SIS, AMSA 
Decision points: Technology demonstrations in spirals 1 & 2 
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Maturity Level - Capabilities for 10.1 Crew- ' J 4 
Centered and Autonomous Operations . 


Sub-Capability Technology Current | Required | | 
CRL CRL le |r 
Crew Centered Planning | Distributed, mixed- 2 (crewed ESMD Spiral2 2010 
initiative constraint-based | missions) 
planning tools (ground 
Graphical interfaces to 2 (crewed re aaa al 
support plan creation and meen) fo 
modification 


Autonomous Health & On-board tools to support aan Spiral2 a 
Safety Monitoring, diagnosis and recovery by 

Analysis and crew 

Anomaly Resolution 
Automated uncertainty SMD MSR 
handling — autonomous ESMD Spiral3 
information gathering for 
resolution 


Rapid creation of ad-hoc 2? ESMD Spiral1 2009 
teams 
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Maturity Level - Capabilities for 10.1 Crew- 
Centered and Autonomous Operations 


Sub-Capability Technology Current | Required Driver Need 
CRL CRL Date 


Autonomous Science Science goal driven 
Analysis, Predictive autonomous 
Modeling, and systems 
Optimization 

Autonomous, Dynamic Embedded, 
Planning continuous planning 

integrated with 
execution decision 
theoretic planning 

Onboard, Robust Execution Reactive task 

decomposition, 
health management 
with goal-achieving 
recover 


Automated Logistics and Inventory / supply 
Inventory chain management 

Multi-Platform Coordination Formation flying 
and Collaboration 


Inter-satellite 
communication and 
networking 


Fleet Management 
(centralized and 
ene ae 


i SMD LISA, MSR | 2007 
SMD Titan 
Aerobot, Europa 
Cryobot 
== - : 


_—— ESMD Spiral2 2010 
ie LISA, 2007 
le 


TBD 


SMD MagCon 2008 


web Web 
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Maturity Level - Capabilities for 10.1 Crew- 
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Sub-Capability Technology Current | Required CRL | Driver Need 
ent Date 


Human Automation Rapid situational ESMD Spiral1 2009 
Interaction awareness 
(visualization of 
complex information 
and actions of 
autonomous 


Decision support rr i Spiral1 2009 
systems 


Trusted autonomy pe MSR Ea 
ESMD Spiral3 Ea 
Multi-modal Interfaces for Multi-media ESMD Spiral2 2010 
Collaborative Execution interfaces 
(presentation and 
Crew observation, ESMD Spiral2 2010 
analysis, and 
assistance 
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Technology 


Distributed, mixed-initiative 
constraint-based planning tools 
(ground and onboard) 


Graphical interfaces to support 
plan creation and modification 


On-board tools to support 
diagnosis and recovery by crew 


Automated spacecraft health 
management with uncertainty 
handling 


Rapid creation of ad-hoc teams 
with critical skills for anomaly 
resolution 
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Components 


Planning engine and 
logic; prioritization 
scheme 


Plan presentation, 
editing, and 
explanation of 
automation 


Presentation of fault 
diagnosis and 


supporting information 


Probabilistic fault 
diagnosis and 
resolution; 
autonomous 
information gathering 
for resolution 


Maturity Level —- Technologies for 10.1 Crew- 
Centered and Autonomous Operations 


Candidates Current 
TRL 


MAPGEN, ASPEN, 
PASSAT 


MAPGEN, SAP 
- 
PSA Agent, DAPRA 
Prognosis Program, 


Army F135 engine 
health management 
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Key Gaps Need 
Date 


Crew centered 
mission planning 
and control 


Advanced 
approaches to 
communication of 
complex context, 
history 
information 


_ _ 


Science goal driven 
autonomous systems 


Goal Capture, Real-time Data 
and Information Fusion and 
Analysis 


Constraint network, heuristic set, 
goal set, uncertainty specs 


Embedded, continuous planning 
integrated with execution 
decision theoretic planning 


State estimation, task 
decomposition, goal assessment, 
recovery, adjustable autonomy 


Robust Execution Technology 


Inventory / supply chain 
management 


Tag (RFID/Barcode), detector 


Formation Control, Relative 
Navigation 


Formation Flying 


Inter-satellite communication 
and networking 
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SGM, Domain specific 
algorithms and models, 
SWIFT TOO and FOM 


ASPEN / CASPER, 
Livingstone, EUROPA 


Remote Agent, IDEA, 
3T/RAPS, APEX, ESL, 
TDL, SCL 


Autonomous Detector 
(PSA) 


SPHERES, 

PSA Agent, Autocon, 
Decentralized Formation 
Control 


API Crosslink 
Transceivers (CLT) 


aturity Level - Technologies for 10.1 Crew- 
Centered and Autonomous Operations 
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Current Key Gaps Need 
TRL Date 
Performance of key | 2007 
algorithms; data 
2010 


interoperability 


Performance, 
verification 


Currently manual. 2010 


2007 


Operational infusion 


7 Verification 2007 
5 
6 
6 
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Maturity Level —- Technologies for 10.1 Crew- 
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Technology Components Candidates | Current | Key Gaps 
TRL 
Fleet Management Path planning and ASF 4 Spacecraft 
(centralized and optimization, collision application 
decentralized) avoidance, collaboration, 
distributed architectures 


Model driven sensor web Data fusion, realtime 4 Performance, 2007 
analysis, sensor interoperability 


collaboration 


Rapid situational awareness | Visualization of complex Communicatio | 2009 
information and actions of n of complex 


autonomous systems information 


Decision support systems Knowledge management 4 2009 
and presentation 

Trusted autonomy 4 Reliability, 2008 

predictability 

Multi-media interfaces Presentation and Clarissa 4 Ease of use 2010 
perception 

Crew support Observation, analysis, and o Ease of use 2010 
assistance 
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Metrics for 10.1 j | ) 


Crew-Centered and Autonomous Operations 


Technology / Current Target | Need Date 
Sub-Capability Value Value* 
Number of CEV (or other major) system Crew centered operations 10,000 1000 Spiral 2 (2018) 
commands issued weekly by ground crew 100 Spiral 3 (2023) 
Hours per week of flight crew time required Onboard automation 1 (done by 1 Spiral 3 (2023) 
for spacecraft operations ground) 
Planned and actual average percent of days | Onboard automation 0 (except 90% TBD 
of onboard autonomous operation for DS1, EO1) 


Size of ground crew for regular and extended | Autonomous mission Varies by Cut by TBD 
missions. Percent of ground crew that must operations mission 75% 


be physically co-located. 


Percent of science decisions (e.g., target Autonomous science 0% (except 75% TBD 
selection, download prioritization, etc.) that analysis and optimization EO1) 


can be done onboard 


Hours per week of flight and ground crew Automated logistics and 
time spent tracking inventory (for CEV, lunar | inventory 


TBD Cut by 
90% 
base or other facility) 
Size of ground team required for coordinated | Multi-platform coordination Cut by 


operation of spacecraft fleets and collaboration 75% 


Minutes required for human ground crew to Situational Awareness NA (no 10 min. 
understand status of remote autonomous current craft 
craft they were not previously monitoring are 

autonomous) 


= *Target values are an educated guess until mission requirenents are finalized. SS = 


sal Technology Candidates 


APEX - Architecture for Procedure Execution (ARC) 

ASF — Adaptive Sensor Fleet (GSFC) 

ASPEN - Automated Scheduling and Planning ENvironment (JPL) 

Autocon — Automated On-board Maneuver Planning (GSFC) 

CASPER - Continuous Activity Scheduling Planning Execution and Replanning (JPL) 
Clarissa — Spoken-Language Dialogue System (ARC) 

CLT — Crosslink Transcievers (APL) 

ESL — Execution Support Language (JPL) 

EUROPA — Extensible Universal Remote Operations Planning Architecture (ARC) 
Livingstone — (ARC) 

IDEA — Intelligent Distributed Execution Architecture (ARC) 

MAPGEN - Mixed-Initiative Activity Planning GENerator (ARC/JPL) 

PSA Agent- Personal Satellite Assistant Agent (ARC) 

Remote Agent — (ARC) 

SAP — Science Activity Planner (JPL) 

SHAC — Shared Hierarchical Activity Coordination (SHAC) 

SCL — Spacecraft Command Language (ICS) 

SGM - Science Goal Monitor (GSFC) 

SPHERES - Synchronized Position Hold Engage and Reorient Experimental Satellites (MIT/ARC) 
TDL — Task Description Language (CMU) 

3T/RAPS — Three-tier Agent/Reactive Action Packages (JSC) 
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Capability 10.2 
Integrated Systems Health Management (ISHM) 


Sub-Team Chair: Serdar Uckun, NASA/ARC 
Sub-Team Co-Chair: Brian Williams, MIT 
Presenter: Serdar Uckun, NASA/ARC 
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¢ Today’s state-of-the-art in spacecraft health is fault detection, 
isolation, and recovery (FDIR). 


Based on fixed detection/isolation logic and recovery procedures. 
Verified and validated using exhaustive testing. 

Fragile (limited modeling of interactions with outside world or across 
subsystems, anomalous behavior depending on rule orderings). 

Not scalable (verification and validation complexity increases 
dramatically with number of inputs/outputs/state variables). 


¢ ISHM is the next frontier in systems health. 


Highly desirable for complex exploration missions in ill-understood 
environments. 


Based on scalable, flexible, model-based detection, isolation, and 
recovery methods. 


Integrated into spacecraft at design stage and not as an afterthought. 
Critical investment for safety, reliability, and mission assurance. 
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This capability area defines capabilities for robust mission operations 
throughout the system lifecycle. 


¢ Design of Health ¢ Real-Time Systems «Informed Logistics 
Management Systems Health Management * Modeling of failure 

* Testability * Distributed sensing for mechanisms 

¢ Maintainability structural health ¢ Prognostics 

- Recoverability ¢ Fault detection, isolation, ¢ Troubleshooting 

- Verification and and recovery assistance 
validation of ISHM ¢ Failure prediction and ¢ Maintenance planning 
capabilities mitigation * End-of-life decisions 

¢ Verification and ¢ Robust control under 
validation of software failure 
under failure ¢ Crew and operator 


interfaces 
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¢ ISHM enables: 
— Mitigation of failures with short time to criticality, 
— Robust execution of critical maneuvers, 
Self-sufficient, crew-centered operations, and 
— Missions in harsh environments. 
¢ ISHM enhances: 
— Long duration missions, and 
— Ground operations (e.g., logistics). 
¢ Additional benefits: 
— Increased crew and payload safety, 


— Reduced maintenance costs through adoption of condition-based 
maintenance policies, and 


— Faster turnaround of reusable systems. 
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¢ Design of Health Management Systems: ——— 
— ISHM functions often designed after initial design of the system. 
— Joint Strike Fighter incorporated prognostics requirements into design. 
— Qualitative failure analysis methods commonly used by NASA (FMEA). 
— Quantitative criticality assessment methods favored by DoD (FMECA). 
¢ Real-Time Systems Health Management: 
— Limited sensing capability (weight and power concerns). 
— Caution and warning events require human expertise to resolve. 
— Inflexible recovery schemes (typically scripted failover to backups). 


— Model-based diagnosis and recovery demonstrated on two NASA 
spacecraft, EO-1 and DS-1. 


¢ Informed Logistics: 
— Limited built-in troubleshooting aids in components and subsystems. 


— Trends in industry beyond fixed scheduled maintenance (e.g., condition- 
based and informed maintenance practices). 


— Prognostics becoming a key driver for systems health (notably JSF and 
Boeing 777). 
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¢ Crewed Missions 
¢ Spiral 1: 2014 Crew Transportation System (CTS) (per ESMD-RQ-0011) 
¢ Detection and annunciation of conditions which could result in loss of human life, 
loss of vehicle, loss of mission, or significantly impact mission capability. 
¢« Autonomous (preferably automated) isolation and recovery from conditions which 
could result in loss of human life or loss of vehicle. 
« Anytime autonomous (preferably automated) abort and crew escape capability. 
¢« Autonomous (preferably automated) rendezvous and docking capability. 
¢ Spiral 2: 2015-2020 CTS and extended-duration lunar surface ops 
¢ Technology demonstration of ISHM for life support subsystems (anticipated). 
¢ Spiral 3: 2020+ Long-duration lunar surface missions 
¢ Prognostics and remaining life estimation for critical subsystems and components. 
¢ Spiral 4: 2025 Mars transit and vicinity ops 
¢ Robust, automated process control and ISHM of all major subsystems on the CTS. 
¢ Spiral 5: 2030+ Martian surface habitat and exploration 


° Above plus ISHM of all major subsystems on the Mars habitat. 
Pre-decisional Draft 
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¢ Robotic Exploration and Science Missions 
— Robotic Lunar Exploration Program (2009+) 


° Automated, robust control and recovery of sensor systems during 
long- -duration reconnaissance missions. 


°0 ISHM and recovery for surface ops (ISRU, drilling). 
— Mars (2011+) 

° Evolutionary enhancements to increase efficiency and science return, 
e.g., fault-adaptive control for surface ops (ISRU, drilling, rover 
mobility). 

— Solar System (2014+) 

° Robust, fault-adaptive control for nuclear reactors. 

° Robust, fault-adaptive control for autonomous high-risk expeditions 
(Venus surface, Titan, Europa, etc.). 

— Observatories (2020+) 


° Robust coordination of multi-spacecraft constellations (e.g., 
interferometers). 
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10.2.3 Informed Logistics 


Reusable systems for CRL 7 Prognostics for 
Spiral 3+? Spiral 3 
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CRL 7 Robust fault-adaptive control: 
for high-risk probes (2015) 
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¢ Verification and validation methods for model-based ISHM (some risk) 
— Driver: ESMD Spiral 1 
— CRL 7: 2009+ 
— Interfaces: System Engineering Cost/Risk Analysis CRT 
¢ Autonomous failure identification and recovery for CTS (some risk) 
— Driver: ESMD Spiral 1 
— CRL 7: 2009 
— Interfaces: In-Space Transportation CRT; System Engineering Cost/Risk Analysis CRT 
¢ Autonomous anytime abort and crew escape decision capabilities for CTS (some risk) 
— Driver: ESMD Spiral 1 
— CRL 7: 2009 
— Interfaces: In-Space Transportation CRT; System Engineering Cost/Risk Analysis CRT 
¢ ISHM for ISRU, remote drilling, surface mobility, and surface assembly tasks 
— Driver: RLEP, MTP, ESMD Spiral 3 
— CRL7: 2011 
— Interfaces: Robotic Access to Planetary Surfaces CRT; ISRU CRT 
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Tools and methods for codesign of function and ISHM 

— Driver: ESMD Spiral 2 

— CRL/7: 2012 

— Interfaces: System Engineering Cost/Risk Analysis CRT 
Robust autonomous monitoring, control, and recovery for life support and other 
subsystems (some risk) 

— Driver: ESMD Spiral 2 

— CRL7: 2012+ 

— Interfaces: In-Space Transportation CRT; Human Health and Support Systems CRT 
Robust fault-adaptive control for autonomous probes in harsh environments 

— Driver: SMD Solar System Exploration, Prometheus 

— CRL7: 2012+ 

— Interfaces: High Energy Power & Propulsion CRT 
Prognostics for spacecraft and habitation systems 

— Driver: ESMD Spiral 3 

— CRL 7: 2016+ 

— Interfaces: In-Space Transportation CRT; Human Health and Support Systems CRT 
Informed Logistics ground infrastructure 

— Driver: ESMD Spiral 3 (assuming reusable systems) 

— CRL/7: 2020 

— Interfaces: Transformational Spaceport CRT; Exploration Transportation System SRT 
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Maturity Level —- Technologies for Design of 
Health Management Systems 


Technology 


Tools/methods for testability 


Function-based failure 
analysis and design 
methods 


Systems analysis and 
optimization for |SHM 
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Components 


Function and Behavior 
Modeling Standards 


Model-based diagnosis and 
recovery engines 


Component function models 
and failure libraries 


Function-based reasoning 
engines 


Sensor placement optimization 


Figures-of-merit tradeoff 
analyses 


Sensor selection 


Candidates 


RMPL, TEAMS, FACT 
Modelica 


Livingstone, Titan, 
HyDE, TEAMS, BEAM 


FACT 


Current 
TRL 
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Key Gaps Need Date 


Established 
standards 


No failure models 


Certification of 
engines; V&V 
methods for 
models; engine 
scalability 


Comprehensive 
failure datasets 


Cost/benefit trade 
studies for 
spacecraft sensor 
systems 


Limited to causal 
diagnosis 


Technology 


Distributed sensing 


Situational 


awareness tools 


Maturity Level - Technologies for Real-Time y . 
Systems Health Management ‘Mi 


Diagnosis and 


Recovery 


ISHM User 
Interfaces 


Components 


Misc. physical and chemical 
sensors 


Sensor power and data 
communications 


Data mining and data 
fusion tools 


Integrated vehicle capability 
and impact assessment 


Model-based diagnosis 


Model-based recovery 


Rule- or dependency-based 
diagnosis 


Displays for crew and 
ground 


Recovery procedures 
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Candidates 


Misc. 


Wired (multiple 
architectures) or 
wireless sensor 
networks 


Misc. commercial and 
R&D tools (e.g., 
BEAM, IMS) 


N/A 


Titan, Livingstone, 
HyDE, HME, CME, 
etc. 


Titan, Livingstone 


SHINE, TEAMS, etc. 


Misc. 


Computer-based 
procedure manuals 


Current 
TRL 


6-7 


9 (wired); 5-6 
(wireless data); 
3-4 (wireless 
power) 


3-7 


4-9 


9 (written); 6 
(computer- 
based) 
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Key Gaps Need Date 


Sensor durability and All missions 


reliability 


Long-term power for 2008+ 
wireless sensors; scalable 


wired architectures 


Visualization of very large 
data sets; effective data 
reduction 


No current investment 


V&V; response time; 
HW/SW and subsystem 
interactions; hybrid systems; 
model acquisition 


V&V; flight validation; 
coverage of continuous 
problem domains 


N/A Available today 
Multimodal interfaces 


On-demand procedure 
generation and verification 


Technology 


Prognostic models 


Physics of failure models 


Maintenance Informatics 
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Components 


Life remaining estimates 


Short-term predictions of 
functional degradation and 
failure 


Mechanical systems; 
propulsion systems; structures; 
electronics 


Planning and scheduling tools 


Distributed logistics databases 
and data analysis tools 


Integrated logistics 
architectures 


Candidates 


Custom models 


Custom models 


Custom models 


CMMD (USCIISI, 
VU/ISIS and DARPA); 
Autonomic Logistics 

(JSF) 


Autonomic Logistics 


(JSF) 


Boeing Sustainment 


Data System 


Maturity Level - Technologies for 
Informed Logistics 


Current 
TRL 


Key Gaps 


Gold standard 
datasets and 
testbeds 


Modeling and 
analysis of 
across- 
subsystem 
interactions 


Understanding 
and quantifying 
effects of 
operational 
environments 


Condition-based 
and informed 
maintenance 
practices 


Conflict between 
access and data 
security needs 
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Technology / Target Value Need 
Sub-Capability Date 


% testability of critical | Tools/methods for 100% 
failures on a Critical testability; System 
Items List (CIL) Analysis and 

Optimization 


Sensor redundancy System Analysis >2 
(alternative means of and Optimization 
confirming the validity 

of data from a 

particular sensor) 


————— re-do SSeS 


Ambiguity group size 


Latency 


Sensitivity (% false 
negatives) 


Specificity (% false positives) 


Sensor durability (years) 


Sensor power consumption 
(watt/hours) 


Caution-warning information 
access (milliseconds) 
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Metrics for Real-Time Systems Health 
Management 


Technology / 
Sub-Capability 


Diagnosis 


Diagnosis and Recovery 


Diagnosis and Recovery 


Diagnosis and Recovery 


Sensors 


Sensors; Sensor Networks 


User interfaces 


Target Value 


1 for CIL items; 2 for 
non-critical items 


< 2 plant time constants 


Low-very low (tradeoff 
on the ROC curve with 
specificity) 


Low-very low (tradeoff 
on the ROC curve with 
sensitivity) 


Order of magnitude 
longer than the nominal 
mission 


Low or none (e.g., 
energy harvesting) 


<500 msec. 
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Need Date 


2009 


2009 


2009 


2009 


2015 
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Technology / 
Sub-Capability 


Prognostic accuracy (+/- % Prognostics 
estimated life remaining) 


Predictive lead time Prognostics and Prediction 
(seconds-hours) 


Short-term predictive Prognostics and Prediction 
sensitivity (% false negatives 
for failure predictions) 


Short-term predictive Prognostics and Prediction 
specificity (% false positives 
for failure predictions) 


Turnaround time Maintenance 
improvements for reusable 
assets 
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Metrics for Informed Logistics 


Target Value 


+/- 10% for CIL items 


At least one order of 
magnitude longer than 
plant time constant 


Low-very low (tradeoff 
on the ROC curve with 
specificity) 


Low-very low (tradeoff 
on the ROC curve with 
sensitivity) 


> 30% time savings 
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2015 


2009 
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BEAM: Beacon-Based Exception Analysis for Multimissions (NASA JPL product) 
CIL: Critical Items List 

CME: Compiled Mode Estimation (MIT product) 

CMMD: Coordinated Multisource Maintenance on Demand (USC/ISI, NASA ARC, Vanderbilt University product) 
CRL: Capability Readiness Level 

CRT: Capability Roadmap Team 

DARPA: Defense Advanced Research Projects Agency 

DoD: Department of Defense 

DS-1: Deep Space One 

DTOOL: Diagnosability Analysis Tool (Vanderbilt University product) 

EQO-1: Earth Observing One 

ESMD: (NASA) Exploration Systems Mission Directorate 

FFDT: Function-Failure Design Tool 

FMEA: Failure Modes and Effects Analysis 

FMECA: Failure Modes, Effects, and Criticality Analysis 

HME: Hybrid Mode Estimation (MIT product) 

HyDE: Hybrid Diagnosis Engine (NASA ARC product) 

IMS: Inductive Monitoring System (NASA ARC product) 

ISRU: In-Situ Resource Utilization 

JSF: Joint Strike Fighter 

RMPL: Reactive Model-Based Programming Language (MIT product) 

ROC: Receiver Operating Characteristics 

RQ: (NASA ESMD) Requirements Division 

SHINE: Spacecraft Healt Inference Engine (NASA JPL product) 

TEAMS: Testability and Engineering Maintenance System (QSI, Inc. product) 
USC/ISI: University of Southern California/Information Sciences Institute 
VU/ISIS: Vanderbilt University/Institute for Software Integrated Systems 


V&V: Verification and validation 


Capability 10.3 
Autonomous Vehicle Control 
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¢ Autonomous vehicle control capabilities are 

necessary to perform critical mission activities 

where time-sequenced or ground-in-the-loop 

control is impossible or impractical. 
¢ Specific sub-capabilities include: 

— Autonomous Rendezvous and Docking 


— Autonomous Orbital Insertion, Maintenance and 
Modification 


Autonomous Entry Descent and Landing 
Autonomous Launch Systems 
— Autonomous Control of Unmanned Air Vehicles 


NOTE: we adopt the ESMD definition of “autonomy”, i.e., activities performed by manned or 
unmanned vehicles without Earth-based operators in-the-loop. That is, “autonomous” implies 
“remote closed-loop”, but does not necessarily imply “fully-automated”. 
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¢ Autonomous Rendezvous and Docking: 
— Mating of separate spacecraft (manned or unmanned) is enabled in remote orbits (e.g., at Mars, 
Lagrange points, in deep space). 
— Return to Earth of samples collected on remote planetary surfaces is enabled (assuming no 
direct-to-Earth transfer of sample from surface). 
— Human safety and operational efficiency is enhanced by allowing autonomous (but human- 
supervised) mating of separate spacecraft in Earth or lunar orbit. 
¢ Autonomous Orbital Insertion, Maintenance and Modification: 


— Robust delivery of manned and unmanned spacecraft into orbit around other bodies is enabled 
(for the purposes of remote sensing and/or eventual delivery to the surface). 


— Delivery of manned and unmanned spacecraft into orbit around the Earth or the Moon is 
enhanced through autonomous (but human-supervised) control of the insertion maneuver. 


— Operations are enhanced (and operations costs are reduced) through autonomous orbit 
maintenance and modification. 
¢ Autonomous Entry, Descent and Landing: 


— Robust delivery of robotic vehicles and cargo from orbital trajectories down to remote 
planetary surfaces is enabled. 


— Safe transportation of humans from orbital trajectories down to remote planetary surfaces is 
enabled by high-precision autonomous entry, descent and landing. 


— Robust/safe transportation of robotic vehicles, cargo and humans from Earth orbit back to 
Earth, and from lunar orbit down to the lunar surface, is enhanced. 
¢ Autonomous Launch Systems: 
— Safe return of humans and samples from remote planetary surfaces back to Earth is enabled. 


— Safe return of humans and samples from the lunar surface back to Earth is enhanced, by 
reducing the complexity of, or even the need for, ground-in-the-loop involvement in launches 
from the lunar surface. 


¢ Autonomous Control of Unmanned Air Vehicles: 
— Control of agile vehicles with aerodynamics and highly dynamic flight paths is enabled. 
— Control of aerobot vehicles in extreme environments is enabled. 
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Sub-capability 10.3.1: Autonomous Rendezvous and Docking 
¢ Significant ground demonstrations and simulations 
¢ On-orbit, unmanned: 

— Visual acquisition and tracking (AFRL XSS-10) 


— Proximity operations, manipulator-assisted docking, relative GPS 
(Japanese NASDA ETS-VII RV&D technology demonstration mission) 


— Autonomous RV&D with ground planning (Progress re-supply of ISS) 


— Under development: Autonomous proximity operations, collision 
avoidance (NASA DART, ~5m), docking (DARPA Orbital Express), 
onboard planning & resource management (AFRL XSS-11), 
identification and capture of non-participatory/tumbling s/c (Hubble 
Robotic Servicing and Deorbit Mission) 


¢ OQOn-orbit, manned: 
— Manned control for final docking (Gemini, Apollo) 
— Significant ground supervision (Soyuz/Progress/Shuttle with MIR/ISS) 
— Shuttle payload operations (Hubble Space Telescope, SPAS, etc) 
¢ Other related or relevant capabilities: 
— Optical-based autonav (DS-1, Deep Impact’s Impactor spacecraft) 
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Sub-capability 10.3.2: Autonomous Orbital Insertion, Maintenance and 
Modification 
¢ Orbital insertion demonstrated with unmanned vehicles: 

— Onboard GNC computations based on delta-energy (not delta-V) for 
optimal arc trajectory burn; event-driven, statechart-based fault 
protection with burn restart capability (Cassini at Saturn) 

— Small-body orbit insertion (NEAR at Asteroid Eros) 

— State-of-the-art in unmanned orbital insertion control has not advanced 
significantly since early lunar, Mars & Venus missions 

¢ Lunar orbit insertion demonstrated with manned vehicles in Apollo 
Program 

¢ Aerobraking for orbit modification of unmanned spacecraft with 
ground-in-the-loop (Magellan at Venus, Mars Odyssey, Mars Global 
Surveyor, ESA Mars Express) 

¢ Aerocapture demonstrated in ground simulations (LaRC, 
JSC/Draper, NASA ST-9 concept study) 
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Sub-capability 10.3.3: Autonomous Entry, Descent and Landing 


Approach navigation: ground-in-the-loop navigation updates (MER) 
Entry: aeroentry control from Mars orbit (Viking 1 & 2); direct entry 
control (Pioneer 2 Multiprobes at Venus, Mars Pathfinder, MER); 
guided entry control (Apollo at Earth); X-38 Crew Return Vehicle 
demonstrator autonomous landing tests 

Parachute descent: unguided for all space applications to date; 
Earth-based guided parachute systems (Sherpa, Precision Air Drop 
System, etc) 

Terminal descent: powered, guided gravity turn maneuver control 
(Viking 1 & 2 at Mars); feature tracking, lateral velocity estimation 
based on descent images (MER DIMES); pilot-in-the-loop hazard 
avoidance (Apollo at Moon) 

System capabilities: precision landing (MER landing ellipse ~8O0km 
x 25km); event-driven sequencing (MER, Huygens, etc) 
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Sub-capability 10.3.4: Autonomous Launch Systems 


¢ Launches currently require significant ground-in-the-loop 
preparation & process control 


¢ EELV lower-cost, simplified launch operations (Boeing Delta IV, 
Lockheed-Martin Atlas V) 


¢ Astronaut-in-the-loop launch sequencing (Apollo lunar ascent 
module) 


¢ Ballistic missiles, ICBMs (e.g., submarine-launched Trident missile) 
¢ “Fire and forget” autonomous missile guidance 


¢ Autonomous launch preparation, planning, initiation, and abort 
determination not yet demonstrated 
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Sub-capability 10.3.5: Autonomous Control of Unmanned Air Vehicles 
Remotely piloted with auto-pilot for nominal flight paths: Predator 
(General Atomics Aero. Systems), Global Hawk (Northrop-Grumman) 
Ground-based coordination of multiple UAVs: J-UCAS (Boeing X-45 & 
Northrop-Grumman X-47), other UCAV programs 

NASA- & DARPA-funded aeronautics research: 


High Altitude Long Endurance aircraft (DFRC remotely-piloted Helios) 
Reconfigurable flight controls research (accommodation of control surface 
failures — DFRC Intelligent Flight Control System) 

Adaptive/morphing wing control research (DFRC Active Aeroelastic Wing, 
DARPA Morphing Aircraft Structures program) 

Earth-based flight demonstrations of single and multiple UAV/rotorcraft 
autonomy, micro UAVs (DFRC, Berkeley, MIT, Stanford, etc) 


Simulations & Earth-based demos for Mars Airplane (ARES, KittyHawk, 
MATADOR, MAGE, etc) 

Aerobot autonomy research (JPL): vehicle management system for 
failure detection/recovery, GPS-assisted horizontal flight control, 
Image-based vehicle motion estimation 
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Manned Missions 


© Spiral 1: 2008-2015 


=" Routine Earth entry, descent & landing 


° eel 2: 2015-2020 
Routine orbital insertion of manned & unmanned lunar orbiting spacecraft 
" High-precision delivery of manned & unmanned lunar landers 
" Ascent from lunar surface, rendezvous & docking in lunar orbit of manned & unmanned 
spacecraft 
" Routine delivery of robotic precursor Mars orbiters and landers 


° Spiral 3: 2020-2025 

" High-precision delivery of massive manned & unmanned Iunar landers 
o Spiral 4: 2025+ 

= Mars transit and orbital insertion of manned spacecraft 
° Spiral 5: 2030+ 

=" Safe pinpoint delivery of manned & unmanned Mars landers 


=" Ascent from Mars surface, rendezvous & docking in Mars orbit of manned & unmanned 
spacecraft 
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Un-manned Missions 


O° 


O° 


O° 


O° 


Orbital Express advanced technology demonstration 2006 
Hubble Robotic Vehicle Deorbit Module ~2008 

Lunar Reconnaissance Orbiter (LRO) 2008 

HALE Remotely Operated Aircraft in the National Air Space 2008 
Mars Science Lab 2009 or 2011 

Lunar robotic sample return ~2011 

Mars Sample Return (MSR) ~2013 

Jupiter Icy Moons Orbiter ~2015 

Terrestrial Planet Finder Interferometer ~2020 
Mars airplane ~2020 

Europa astrobiology lander ~2020 

Mars, Venus, Titan aerobots ~2020+ 

Mercury sample return ~2023 

Venus sample return ~2023 

Neptune orbiter with probes ~2025 

Titan sample return ~2027 
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7 + Automated launch + Prec. landing : : 
o s prep. & init. * Haz. avoid. Cooperative Safe approach, 
Ss + Automated target *Att.controlin sje docking: prox ops, docking 
«2 acq. & tracking remote atm. : ; : 
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10.3.1 Autonomous Rendezvous and Docking : i 
MTO Rendezvous & CRL7 


Aut. Nav. demo 


10.3.2 Autonomous Orbital Insertion, i ‘ ; 


Maintenance, and Modification LISA constellation —: : CRL7 JIMO orbit 


orbit maintenance : : : maintenance 
10.3.3 Autonomous EDL 
MSLEDL CRL7 : i 
precision : : ; 
landing i : : 
10.3.4 Autonomous Launch Systems —_ ae 92> ot 9 
CRL7 : i 
10.3.5 Autonomous Control of UAVs 
Robust CRE 
Robust Execution cd i 
———_?A-Y oT SS _—__ dvr rh 
CRL7 
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Europa M Venus Titan 
TPF-Interf. Lander oo” ” Neptune F Sample 
oo (2020) Venus, oe o Ley Orbiter Life * Spiral 5 Planet 
Titan Sample Giipeshes Finder A Imager 
Mars Airplane Aerobots Returns (2026) (2025) Spiral 4 (2035) 
: (2020) (2020+) (both 2023) A i a 
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i+ Onboard planning i i i i i Abort : 


10.3.1 Aut. RV&D 


10.3.2 Aut. OIM&M 


10.3.3 Aut. EDL 


10.3.4 Aut. Launch 


10.3.5 Aut. UAV Control 


Robust Exec. 


Enhancing/ Ready to Use 


© Major Decision A Major Event / Accomplishment / Milestone Evolutionary (TRL 6) 


asa Deliverables for Capability 10.3 


Autonomous Vehicle Control ps 


[ | Pics Dsasrenen CBence 


Autonomous Rendezvous and Docking: automated target acquisition, 
target orbit/trajectory determination, target approach, safe proximity 
operations, docking of cooperative spacecraft, capture of non- 
participating targets (Moderate risk) 

— Drivers: Mars Sample Return, ~2013; Spiral 1, CEV docking, ~2014; Spiral 2, 

Crewed Lunar surface missions, ~2015+ 
— CRL7 date: 2010 
— Interfaces: 9: HES&M, 10.8: AR&C/CS, 12: SI&S, 14: AMSA 


Autonomous Orbital Insertion, Maintenance and Modification: automated 
body-relative navigation & maneuver planning, aerobraking & 
aerocapture (Significant risk for aerocapture) 


— Drivers: Terrestrial Planet Finder, ~2020; Spiral 4, Crewed Mars orbital 
missions, ~2025 


— CRL7 date: 2015 
— Interfaces: 10.8: AR&C/CS, 14: AMSA 


Autonomous Entry, Descent and Landing: pinpoint landing with <100m (3 
sigma) accuracy, hazard avoidance (Significant risk) 


— Drivers: Mars Sample Return, ~2013; Spiral 2, Crewed Lunar surface missions, 
~2015+; Spiral 3, Long Duration Crewed Lunar surface missions, ~2020+; 
Spiral 5+, Crewed Mars surface missions, 2030+ 


— CRL7 date: 2010 
— Interfaces: 6.3: RAPS/EDL, 7: HPLS, 10.8: AR&C/CS, 12: SI&S, 14: AMSA 
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Autonomous Launch Systems: automated launch preparation (fueling, 
ignition, etc), initiation and abort, attitude control in remote planetary 
atmosphere (Moderate risk) 


— pes Mars Sample Return, ~2013; Spiral 5+, Crewed Mars surface missions, 
+ 


— CRL 7 date: 2010 
— Interfaces: 13: ISRU, 2: HEPP, 10.8: AR&C/CS, 14: AMSA 


Autonomous Control of UAVs: robust reconfigurable flight controls, 
onboard mission planning/replanning, coordination of multiple UAVs, 
adaptive/morphing wing control 


— Drivers: HALE ROA in the NAS, 2008; Mars airplane, ~2020; Mars/Venus/Titan 
aerobots, ~2020+ 


— CRL7 date: 2015 
— Interfaces: 6.4: RAPS/AS, 10.8: AR&C/CS, 14: AMSA 


Cross-cutting capability: robust execution 


— Drivers: Lunar robotic sample return, 2011; all other complex science & 
exploration missions 


— CRL 7 date: 2009 
— Interfaces: 10.2: AR&C/ISHM, 10.4: AR&C/APC&EA, 10.8: AR&C/CS, 15: SECRA 
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Breakthrough Capabilities for 10.3 } ; ) 
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Safe, autonomous, pinpoint landing 


To enable a sustained exploration campaign, teams of humans, robots and their supplies 
must be delivered with tremendously high precision and reliability to the surface of the Moon, 
Mars, and other remote planetary bodies. The current state-of-the-art atmospheric entry, 
descent and landing system (e.g., MER) provides sub-100km landing ellipse with a “rough” 
airbag landing. A capability breakthrough is needed in order to achieve two orders of 
magnitude improvement in landing precision, while improving reliability to meet safety-critical 
standards. This will require a return to the propulsive terminal descent control systems of the 
types used for the Apollo lunar landings and the Viking Mars landers, coupled with significant 
advanced autonomy technology to assure the necessary reliability and robustness for safe 
human exploration. In particular, this capability will require advances in robust execution, 
autonomous GN&C algorithms, sensor fusion, machine vision, and feature 
recognition/classification. 


Autonomous rendezvous and orbital maintenance 


Launch mass/cost constraints will drive the development of breakthrough robotic in-orbit 
maintenance and assembly capabilities, including autonomous vehicle control for rendezvous 
and docking. These capabilities will require significant technological advances including 
robust execution, autonomous GN&C algorithms, and maneuver planning. 


Similar technological advancements will enable successful and affordable operation of future 
space-based observatories and remote planetary networks consisting of multiple coordinated 
spacecraft. A breakthrough in autonomous control will be required in order to operate such 
systems with reasonably-sized ground operations teams and to address the complex 
coordination and resource management challenges associated with such missions. 
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Sub-Capability 


Autonomous 
Rendezvous 
and Docking 


Autonomous 
Orbital 
Insertion, 
Maintenance & 
Modification 


Autonomous 
EDL 
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Technology 


¢ Automated target acquisition & 
tracking algorithms, 

¢ GNC algorithms for safe 
approach, proximity ops, and 
capture of cooperative and non- 
participating spacecraft 


¢ Automated body-relative nav & 
maneuver planning, 


¢ Algorithms for automated 
aerobraking & aerocapture 


¢ Libration halo orbit maintenance 


¢ Nav algorithms for pinpoint 
landing, 

¢ Guided entry control algorithms, 
¢ Optimal-fuel guidance 
algorithms, 

¢ Feature tracking, hazard 
recognition & avoidance 
algorithms 


Current CRL Required 


3-4 


3-4 
(100m 
accuracy, 
1m haz) 


Maturity Level -— Capability 10.3 
Autonomous Vehicle Control 


CRL 


6-7 
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Driver 


MSR, 
Crewed 
Lunar 
Surface 
Missions 


Crewed 
Mars Orbital 
Missions, 
Large Space 
Telescopes 


MSR, 
Crewed 
Mars 
Surface 
Missions 


Need 
Date 


~2010 


~2015 


~2010 


S 


Sub-Capability 


Autonomous 


Launch 
Systems 


Autonomous 


Control of 


UAVs 


All 
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Technology 


¢ Automated launch 
preparation (fueling, ignition, 
etc) & initiation, 

¢ Attitude control in remote 
planetary atmosphere 


¢ Robust reconfigurable flight 
control algorithms, 

¢ Onboard mission activity and 
path planning, 


¢ Algorithms for coordination 
of multiple UAVs, 


¢ Adaptive/morphing wing 
control algorithms 


Robust execution 


Current CRL 


3-4 


3-4 
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Required 
CRL 


6 


Driver 


MSR 


Mars 
Airplane 


Lunar 
Robotic 
Sample 
Return 
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Need 
Date 


~2010 


~2015 


~2009 


S 


Technology 


Robust execution 
software 


Automated target 


acquisition & tracking 


algorithms, feature 
tracking algorithms 


GNC algorithms for 
safe approach, 
proximity ops, and 


capture of cooperative 


and non-participating 
spacecraft 
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Components 


State/model-based 
execution with 
integral fault 
management, 
procedural & rule- 
based execution 


Vision-based 
target/feature 
recognition, 
target/feature 
tracking 


Manipulator- 
assisted docking, 
Trajectory planning 


Candidates 


MDS (JPL), RMPL 
(MIT), TDL (CMU), 


ESL (JPL/ARC), 
SCL (ICS) 


Extensions to Deep 
Impact impactor 
targeting & 
guidance, machine 
vision research 


ETS-VII, SSRMS 


Kirk-MILP (MIT, 
etc), D* (CMU etc), 
RRT (U of 1), RL 
(Stanford, etc.) 


Maturity Level - Technologies for Capability 10.3 
Autonomous Vehicle Control 


Current 
TRL 


4-5 


Key Gaps 


Large-scale 


system 
demo 


Demo in 


space 
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Need 
Date 


2009 


2010 


application 


Fully- 


2010 


automated 
end-to-end 


demo in 


space 


application 


Technology Components 


Automated body- 
relative nav & maneuver 
planning 


Algorithms for 
automated aerobraking 
& aerocapture 


Navigation algorithms Relative GPS- 
for pinpoint landing based nav 


Guided entry control 
algorithms, optimal-fuel 
guidance algorithms 


Hazard recognition & Vision-based 

avoidance algorithms target/feature 
recognition, 
Classification 
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Candidates 


Evolution of DS-1 
Autonav, Deep 
Impact impactor 
guidance 


Automation of 
current aerobraking 
ops process, ST-9 
aerocapture study 


Evolution of MSL 
EDL GN&C 


Modified Apollo 
Guided Entry, 
Evolution of MSL 
Entry GN&C 


Modified MER 
DIMES algorithm, 
machine vision 
research 


Maturity Level - Technologies for Capability 10.3 
Autonomous Vehicle Control 


Current 
TRL 


4 
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Key Gaps 


Autonav- 
maneuver 
control loop 
closure 


Robust fault 
protection 
(deflection 
maneuver 
execution) 


Sufficient 
accuracy & 
precision 


Algorithm 
speed 
(computation 
speed) 


Hazard 
recognition 
from descent 
images 


Need 
Date 


2009 


2015 


2010 


2010 


2010 


asa Maturity Level - Technologies for Capability 10.3 
Autonomous Vehicle Control 
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Technology Components Candidates Current Key Gaps Need 
TRL Date 
Automated launch Modified ELV, 3 Adequate 2010 
preparation (fueling, missile launch observability 
ignition, etc) & initiation process control into process, 
sensor fusion 
Attitude control in Modified ELV, 3 Atmospheric 2010 
remote planetary missile control model fidelity 
atmosphere systems 
Robust reconfigurable Research for 4 Flight demo 2018 
flight controls X-33, X-36 
Onboard mission Deliberative goal- CASPER,MDS 7-8 Large-scale 2018 
planning/replanning based planning (JPL), system 
PLASMA demo, 
(ARC), Kirk algorithm 
(MIT) speed 
Coordination of multiple | Distributed Kirk-MILP 3 Large-scale 2018 
UAVs planning (MIT), system 
Maneuver demo, 
automata algorithm 
(U of |, MIT, speed 
Stanford) 
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etrics for Capability 10.3 


Metric 


Time to react to events 
and faults 


Cost of critical sequence 
development & validation 


Error in target trajectory 
estimate 


Likelihood of successful 
docking 


Error in achieved orbit 


Cost of operations 


Pinpoint landing accuracy 


Likelihood of hazard-free 
touchdown 


Mean error in launch 
trajectory vs. intended 
profile 


Pre-decisional Draft 


Autonomous Vehicle Control 


Technology / 
Sub-Capability 


Robust execution, 
Onboard mission replanning 
(for UAVs) 


Autonomous RV&D, Ol, 
EDL, Launch 


Autonomous Rendezvous & 
Docking 


Autonomous Rendezvous & 
Docking 


Autonomous Orbital 
Insertion 


Autonomous Orbital 
Maintenance, Autonomous 
Control of UAVs 


Autonomous EDL 


Autonomous EDL 


Autonomous Launch 


Target Value 
Fig of Merit 


O(microsecs) for 
execution, 
O(seconds) for 
replanning 


Factor of 10 
improvement 


3-sigma < X meters 
99.99% 

3-sigma error < X for 
each orbital param. 
Factor of 10 
improvement 
3-sigma error < 100m 


99.99% 


3-sigma < X meters 
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Need 
Date 


2011 for 
execution, 
2020 for 
replanning 
2015 
2013 
2015 
2015 


2015 


2015 


2030 


2013 
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Capability 10.4 Autonomous Process 
Control and Embedded Autonomy 


Presenter: James Crawford, NASA/ARC 
Team Lead: James Crawford, NASA/ARC 
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apability 10.4 Process Control and 
Embedded Autonomy 


Nasal ° ps | 
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¢ Autonomous process control encompasses the automation 
of mission-critical systems that, in terrestrial analog 
applications, require continuous human monitoring and 
intervention. 


¢ Example applications include: 
— Process control for closed-loop life support 
— Process control for ISRU 
— Process control for nuclear reactors 
— Process control for deep drilling 


— System-level automation and intelligence for power, 
propulsion, thermal, communication, GN&C (guidance, 
navigation, and control), C&DH (command and data handling), 
and other systems 
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Benefits of 10.4 Process Control and J y ] 


Embedded Autonomy 
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¢ Increased system robustness 

¢ Rapid reaction to off-nominal events 

¢ Increased crew autonomy (for manned missions) 
¢ Decreased operations costs 


¢ Enables complex remote operations (e.g., closed-loop life 
support, ISRU, Brayton-cycle nuclear reactors, deep drilling, 
etc.) 

¢ Reduction in (material) buffers (and thus mass) through 
more effective control 
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asa Current State-of-the-Art for 10.4 | 
Process Control and Embedded Autonomy 
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The Space Station is manually controlled from earth. 
Ground controllers issue roughly 500,000 commands per 
year. 
— Flight crew can, at least in theory, handle emergencies without 
ground support (for some period of time) 
For unmanned missions, some critical sequences (e.g., 
entry, descent, and landing) are automated but most 
systems are monitored and controlled from earth 
— Outside of critical sequences, the state of the art is for the craft 
to go into a quiescent “safe” mode 
Limited technology demonstrations (e.g., DS1 and EQ1) of 
onboard autonomy have been performed. 


No full demonstrations of automated process control for 
closed-loop life support, nuclear reactors, ISRU, or other 
systems. 
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asa Requirements /Assumptions for Capability 10.4 J ] » 


Manned Missions 


° Spiral1: 2014 CEV LEO 
c Spiral 2: 2015-2020 CEV LLO and EVA lunar surface ops 


= Technology demonstration of process control for life support 


© Spiral 3: 2020 Lunar surface habitat 


= Automated process control of all major systems (CEV, habitat, and vehicles) 
during nominal operations (under Mars latency). Process control for nuclear 
reactors? 


c Spiral 4: 2025 Mars transit and vicinity ops 


= Automated process control of all major systems during nominal operations 
and fault recovery, ground as advisor 


c Spiral 5: 2030+ Martian surface habitat and exploration 
= Above plus process control for ISRU and surface vehicles 
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Requirements /Assumptions for Capability 10.4 
Process Control and Embedded Autonomy 
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— Un-manned Missions 


o Mars 
= Process control for ISRU 
= Process control for drilling and sample handling 
= Process control for complex in-situ scientific analysis 


co Planetary 
= Process control for nuclear reactors 
= Process control for complex in-situ scientific analysis 
= Autonomous systems for cases where communications is limited (Venus 
surface, Titan, Europa, etc.) 


co Observatories 
= Control for interferometry 


o Lunar 
= Process control for ISRU 
= Process control for drilling 
= Process control for in-situ science, 
= Process control for nuclear reactors? 
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Autonomous Process Control: a | 
Capability Roadmap [ ' / A 


Mars 


CRL7 


10.4.1 Process Control for Life 
Procedural vs. 3-level : 
(Spiral 2) 


Support 


10.4.2 Process Control for ISRU CRL 
7 
Procedural vs. 3-level 


CRL 7 


10.4.3 Process Control for Nuclear ; 
FMEA vs. Procedural vs. 3-level 


Reactors 
10.4.4 Process Control for Deep CRL7 
Drilling Procedural vs. 3-level 
10.4.5 Modular Plug-and-Play 
Controllers CRL7 Use in Spiral 2? 
(Spiral 2) 


10.4.6 Smart Systems 
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Enhancing/ 


© Major Decision A Major Event / Accomplishment / Milestone : : Ready to Use 
Evolutionary : 


Driving 
Missions 


AR&C 
Capabilities 


Autonomous Process Control: 
Capability Roadmap 


Prometheus Spiral 3 Titan Aerobot Planet Imager 
x 4 - Europa Cryobot 
Mars Deep Drill i i ? Venus Aerobot Spirals 4&5 


Smart 


: : Systems, — 
Process Process , Process : 
Control Control : Control omar 
for Dee i for Life 
p for Nuclear : Systems 


Drilling Reactors Support 


10.4.1 Process Control for Life 
Support CRL7 : 
(Spiral 3) : 


10.4.2 Process Control for ISRU << /—— —— 


10.4.3 Process Control for Nuclear 
Reactors 


10.4.4 Process Control for Deep 
Drilling 


10.4.5 Modular Plug-and-Play 
Controllers CRL7 
(Spiral 3) 


10.4.6 Smart Systems 
CRL 7 CRL 7 
(Spiral 3) (Spiral 4&5) 
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Deliverables for Capability 10.4 Process } ) 


Control and Embedded Autonomy 
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Process control for life support: management of material buffers, automation of 
routine operations, management of system consisting of multiple chemical and 
biological life support devices, monitoring and fault recovery (joint with ISHM) 
(Some risk for fault recovery) 


o Driver: ESMD spirals 2-3 
° CRL 7: 2015 
o Interfaces: human environment capability team 


Process control for |ISRU: management of flows and processes, automation of 
routine operations, monitoring, and fault recovery (joint with ISHM) (Some risk) 


o Driver: Mars and lunar precursor missions 
o CRL 7: 2011 
° Interfaces: ISRU capability team 


Process control for nuclear reactors: management of flows and processes, 
automation of routine operations, monitoring and fault recovery (joint with ISHM) 
(Moderate risk) 


° Driver: Prometheus reactor deployment 
° CRL 7: 2015 (estimate) 
° Interfaces: HEPP (2.0), “Nuclear Systems” strategic roadmap 


Process control for drilling: management of drilling process, automation of 
routine operations, monitoring and fault recovery (joint with ISHM) (Some risk) 


° Driver: Mars and lunar programs 

o TRL 6: 10M in 2013, 100M in 2025 

o Interfaces: HESM (9.0), RAPS (6.0) 
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Sub- Technologies Current | Required | Driver Need 
Capability CRL CRL Date 


¢ Process-control software architectures 


Process * Monitoring and state estimation 


Control for | . Robust execution spirals 2-3 


Life Support 
elie * Planning and replanning (including fault recovery) 


¢ Multi-variant optimal control (including off-nominal) 
* Model estimation 


¢ Process-control software architectures 
Process * Monitoring and state estimation Mars and 
¢ Robust execution 


Control for 
In-Situ precursors 


Bocoures * Planning and replanning (including fault recovery) 
Utilization ¢ Multi-variant optimal control (including off-nominal) 
* Model estimation 


* Process-control software architectures 
Process * Monitoring and state estimation 1-2 Prometheus | 2015? 
7 - Robust execution 
Reactors ¢ Planning and replanning (including fault recovery) 

¢ Model estimation 
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for 10.4. Process Control 


* Process-control software architectures 

Process * Monitoring and state estimation 

3 for * Robust execution 

Drilling ¢ Planning and replanning (including fault recovery) 
* Model estimation 


¢ Process-control software architectures 
Modular * Monitoring and state estimation 
¢ Multi-variant optimal control (including off-nominal) 
* Model estimation 


Plug-and- 
Play 
Controllers 


* Process-control software architectures 
Smart * Monitoring and state estimation 1-5 
fre * Robust execution (varies 
Hens: ¢ Planning and replanning (including fault recovery) se 
comm., ¢ Multi-variant optimal control (including off-nominal) 


C&DH, etc.) | * Model estimation 


Maturity Level - Capabilities 
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Sub- Technologies Current | Required | Driver Need 
Capability CRL CRL Date 


Mars and 
Lunar 
programs 


ESMD 
spirals 1-2 


ESMD 
spirals 1-2 
Mars and 
SSE 
programs 
(enhancing) 


2013 (to 
10M) 


2025 (to 
100M+) 


2009 — 
2020 
(varies 
by sub- 
system) 
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for 10.4. Process Control 


Maturity Level - Technologies J 4 4 
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Technology Components | Candidates Key Gaps 
TRL* 


Process-control ¢ Three-level architectures 
architectures * Procedural systems 


Monitoring and * Model-based monitoring * Elimination of false- 


¢ Validation techniques 
for complex systems 


state estimation * Statistical analysis positives in complex 
- Expert systems hybrid systems 


Robust * Model-based execution * Recovery from 
unexpected anomalies 


¢ Validation 


2-6 
i: 
Planning and ¢ Generative planning 3-9 ¢ Mixed-initiative 
replanning * Local repair planning 
* Validation of onboard 
2-4 


execution ¢ Procedural execution 


planners 
Multi-variant 
optimal control 


Model * Inductive learning * Validation 
estimation 


* For many of these technologies the TRL level varies widely by application domain. For example, 
robust execution for shallow drilling (~2M) is TRL 6 because demonstrations have been done in 
relevant environments. However, for process control of Nuclear Reactors the same technology is TRL 
2 because demonstrations have not yet been attempted. 
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Flight crew hours per week required for 
process control of life support (assuming 
Mars-like communication with ground) 


Interventions per week by ground team to 
correct anomalies in ISRU plant 


Interventions per week by ground team to 
correct anomalies in Nuclear Reactor 


Depth of autonomous drilling in a variety or 
rock types 


Number of spacecraft systems that can be 
controlled by standard controller 


Flight crew hours per week required for 
control of major flight systems (assuming 
Mars-like communication with ground) 


Metrics for 10.4 
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Technology / Target Need 
Sub-Capability Value Date 


Process Control of Life Support 2015 
Process Control of ISRU 1 (none 2011 
mission 
Critical) 


Process Control for Nuclear Reactor 1 (none 2010 
mission 
critical) 

Process Control for Drilling 10M 2013 
100M 2025 

Modular Plug-and-Play Controller Most 2015 
systems 


“Smart” systems Less than 2015 
1 hour for 
most 
systems 
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asa Overview : 4 
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Introduction (Steve Zornetzer) 


Process, Mission Drivers, Deliverables, and Interfaces (James 
Crawford) 


Autonomy (James Crawford) 
— Crew-Centered and Remote Operations 
— Integrated Systems Health Management 
— Autonomous Vehicle Control 
— Autonomous Process Control 


Robotics (Paul Schenker) 
— Robotics for Solar System Exploration 
— Robotics for Lunar and Planetary Habitation 


— Robotics for In-Space Operations 
Computing Systems (Mike Lowry) 
Conclusion 
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Introduction to sub-capabilities 10.5-10.7 


Robotics 


Presenter: Paul Schenker, JPL 
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S& Robotic and Human-Robotic Systems [}” : 
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Exploration Systems: 


¢ Expeditions on-or-near solar system bodies, including 
sustained robotic access to very rugged and adverse 
environments (lunar, planetary, and related small bodies). 
Robotic capabilities will evolve to human-robotic. 


¢ In-space assembly, inspection, and maintenance of 
instruments or facilities, with extension to surface 
habitat development and servicing 


Required Capabilities: 
¢ Dexterous human/robotic work systems; agile 
aerial, surface, and sub-surface autonomous explorers 
... ‘go where we currently can’t—survive—do breakthrough science” 


¢ Advanced mobility, manipulation, and on-board intelligence 
technologies, enabling efficient human/robotic task inter- 
actions and multi-robot cooperation for larger tasks 
... “autonomy—an integrative bridge for large scale systems” 


115 
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Diverse Mission Applications ’- ¢ 


Pre-decisional Draft 


¢ Robotics for Solar System Exploration (CRM 10.5) 


¢ Robotics for Lunar and Planetary Habitation (CRM 10.6) 


¢ Robotics for In Space Operations (CRM 10.7) 


Robotics Capability Breakdown 


Autonomous mobility and access (surface, aerial, and sub-surface) 
Autonomous instrument deployment (from landed and mobile platforms) 
On-board autonomous science 

Human-robotic field science (robotic scouts, assistants, telepresence, multi-robot cooperation) 
Human-robot interaction (remote and on-site Cl for mission planning, operations, monitoring) 


Site development (survey, excavation, initial construction, resource deployments) 
Site maintenance (inspection, repair, assembly, materials transport & warehousing) | “& 
In situ resource production (robotic support to extraction, transport, manufacturing) ey - 
Field logistics and operations support (materials & equipment transport & warehousing) 
Human-robot interaction (H/R task allocation, teleoperation, remote supervisory control, etc. 


Assembly (manipulation, preparation, connecting, self-deployment) 
Inspection (structural, access, component/system failure detection) 
Maintenance (staging, H/R interface rated manipulation, grapple dexterity) 
Human-robot interaction (multi-agent teams, communication of intent, time delay eoiapenestion) 
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Science Exploration “a ) 


Examples & Requirements Ma 
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(Reference: NEXxT Study on Space Robotic Capabilities) 


Surface Mobility 


(Mobile Autonomy) 
Terrain assessment, path 
planning, visual servoing 


(Mobility Mechanization) 


Extreme terrain access, 
energy efficiency 


ae Tele-operation and 
»~, human supervision of 
robotic explorers 


Robotic work crews 
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Science Perception, 
Planning & Execution 


be at dig On-board and ground tools; 

, a data analysis, target selection, 
“= operations planning and 
er , execution 


Instrument Placement and 
Sample Manipulation 


Position sensors, collect and process 
samples 


May include sample containerization 
and return-rendezvous phases 


In-Space Operation 7 ~y 
Examples & Requirements Sy 
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(Reference: NExT Study on Space Robotic Capabilities) 


Assembly Inspection 


Visual inspection of 
exterior spacecraft 
surfaces; path planning 
_ and coverage planning; 
| automated anomaly 


Transporting and mating 
of components; making 
connections; assembly 
sequence planning and 


execution; assembling detection 
small structures 
Maintenance Human EVA Interaction 
Change-out of Monitoring and 
components; documenting EVA tasks; 


accessing obstructed 
components; robotic 
refueling 


preparing a worksite; 
interacting with 
astronauts; human-robot 
teaming 
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Mission Enablement & System Trends ” ) 


(Space operations will grow in scale—robotic systems will grow in complexity) 


FRevenes Prices 6 | a Ome 


SOLAR SYSTEM EXPLORATION In-Space Assembly 
- Explore large aerial, surface, & sub-surface regions mays, 

* Precision instrument placement & deployment 

¢ In-situ dig, drill, scoop, manipulate, and process 

* Sustained autonomous operations & resource mgmt 
¢ Cooperative robotic & human/robot task execution 


ASSEMBLY, INSPECTION, MAINTENANCE SRT MAL . 
* Fast, structure-attached crawling 

* Handling of small parts, flexible films ESSIEN UO CRE 
¢ Deploy & adjust delicate optical elements 
* Heavy-duty work from unstable bases 

¢ Material acquisition, transport, deployment 


| Robonaut 


Mobile / Manipulative Degrees of Freedom 


10 SSRMS (2000) Mars Drill 
MER (2003) ---+ 
AERcam 
SRMS (1985) 
Flight 
Operational 
Systems 
1 10 100 1000 ——~ 


Robot Range or Operational Workspace (meters extent) —_ 
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Robot Physical 
Characteristics 


Robot Environment Unexplored Terrain; 
Extreme Cold/Heat 


Distance from Control 
and Command Station 


Robot Level of 
Autonomy 


Robot Manipulators 


Robot Vision 
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Light, Mass & Volume 
Constrained 


Up to Millions of 
Kilometers 


Semi-Autonomous 
(long time-delay) 


Pick-Up and Handle 
Small Objects (e.g. 
rocks); Low-Gravity 
Manipulation of 
Human-Made Objects 


Discover Interesting 
Science Samples; 
Detect Natural Hazards 


Sturdier; Re-Usable; 
Can Resist Wear and 
Tear 


Earth Terrain; On-Road 
& Off-Road 


Few Kilometers 


Teleoperation/Semi- 
Autonomous (short 
time delay) 


Lift and Handle Heavy 
Loads 


Detect & Track Human 
Objects (walking 
soldier; moving lead 
vehicle) 


Inter-Agency Robotics Drivers J 


(Space imposes unique requirements and constraints) 


[ | Prices o Dasaenen Ome 


Sturdier; Re-Usable; 
Can Resist Wear and 
Tear 


Radiation Rich Sites 


Up to 1 Kilometer 


Teleoperation/Semi- 
Autonomous (short 
time delay) 


Lift and Handle Heavy 
Loads 


Inspect Hazardous 
Sites; Cluttered 
Environment 


Mars Exploration Rover Mars Science Laboratory 


Landed Mass ~600 kg 
Designed Driving 600 m 5000-10,000 m 
Distance 

Mission Duration 90 sols 687 sols 
Power/Sol 400 - 950 w/hr ~2400 w/hr 
Instruments (#/mass) 7/5.44 kg 6-9/65 kg 

Data Return 50-150 Mb/sol 100-400 Mb/sol 


500-1000 Mb/sol (with MTO) 


EDL Ballistic Entry Guided/Precision Entry 
rre-deccision! Dhol SaaS image no etonsc sian 


Two Fundamentally Different Approaches, 
or a Capability Convergence? 


Teleoperation 


Supervised Autonomy 


Structured, often well-modeled, sometimes cooperative environment 
Low latency or none, but past 250 msec, a new operational regime 
Global viewing is limited, can be obscured, low fidelity is an issue 
Sensory feedback often multi-modal and non-intuitive to operator 
Secondary workload is an issue, may require multiple operators 
Dexterity, haptics, human-rated performance of interest (metrics?) 
Evolution of teleoperation to telerobotic shared and traded control 
Signal-Sign-Symbol, “Visually Servoed-Guided-Designated”, etc. 


Unstructured, partially-modeled, rarely a “cooperative” environment 
High latency, structured planning/CDH, limited contingency handling 
Limited mass, volume, power, and communication; compute bound 
Localized perception and situational awareness primary to s/c safety 
Mid-range localization/servoing and analog planning key to efficiency 
Long range localization and global coordination a key to networking 
Operator may enter planning, monitoring, and control at multiple levels 
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EXAMPLE: Teleoperation Task ) | 


JPL-GSFC Satellite Servicing under Variable Communications Latency 


FRevexes Pisce ne ; 


ORU Change-Out Task with Predictive Graphics and Compliance Control 


r ~ 
Se ww; ~ — ty! 
Maer = 
4% Onn . 

: iB J - 7 
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; 
. 


tr 
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th 


JPL Operations Site GSFC Servicing Site 


6-to-15 seconds asynchronous 
communications delay 
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Needed Capabilities 
Manipulative instrument placement 
Sample processing and handling 
Navigational long range traverse 
Rough terrain mobility & safety 
Multi-sensory state estimation 
Visual tracking, localization 
Local area mobility planning 


Cooperation of multiple robots 


* Activity sequencing / visualization 


Enabling Technologies 


On-and- 
Near SSE 
Bodies 


On-Board Intelligence 
Manipulation 


Mobility : 
Human/Robot : 
System Architectures : 


Distributed & cooperative agents ,. 
Reconfigurable, redeployable robots 


Telerobotic & teleprogrammed control 
Visualization & designation interfaces 


Sequencing & contingent planning 
Reactive, reflexive system GN&C 
Sensory fused global perception 
Multi-modal operations interfaces 
Teleoperation with latency 


In-Space 


Robotic Sub-Capabilities (10.5-10.7) a 


Commonality of Architectures and Components 


[a ey | Se 


Unified Human/Robot Operations 
Cooperative H/R work on orbit and surfaces 


Surface preparations for human explorers 


Instrument deployments for mission crew 


Robot assistance to EVA exploration 


Robotic risk mitigation to spacecraft and 
crew Safety (inspection & intervention) 
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Needed Capabilities 
Manipulation of parts / assemblies 
Traverse of large space structures 
Grapple dexterity on trusses, etc. 
Transport, docking, and deployment 
Multi-sensor modeling / recognition 
Visual tracking, localization 
Local structure mobility planning 
Cooperation of multiple robots 


Activity sequencing / visualization > 


Required Capability 


Command Cycles per 
Operation for Surface 
Mobile Exploration 


Range of Operations 
(Planetary Surface) 


Access to Adverse and 
Rugged Terrain 


Networked Robotic 
Systems (Surface) 


Level of Dexterity 


Range of Operations 
(In-Space Systems) 


Networked Robotic 
Systems (In-Space) 


EXAMPLE: Capability Trends (1) 


Current TRL 


4 
4-9 
2-9 
2-3 
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Now (TRL varies) 


Sur" Mobili 


Mobility: 10+ meters 
per command (MER) 
Manipulation: 3-4 sols 
per instrument 
placement (MER) 

> 1 kilometer linear 
path (MER) 


VL 1 terrains, recent 
MER post-baseline 
ops on 30 deg. slopes 
Concept demos of 
shared payload 
transport (TRL 4) 


Figure of Merit 
In 2008 (TRL 6) 


Mobility: 1 Kilometer 
per command 
Manipulation: 1 
science measurement 
per command 

>1000 Km/2 incl. use 
of aerial or multi- 
agent systems 

> VL2 terrains, 
vertical cliffs, cratered 
walls 

Full scale terrestrial 
demo of power station 
/ habitat deployment 


In-Space Mobile Dexterity 


Teleoperatively 
Grapple Large (>1 
m3) ORUs (STS) 
Fixed base (SRMS, 
SSRMS) operations; 
100 meter linear track 
(MSS/SPDM) 
Cooperative transport 
and docking by free- 
flyers, air-table demo 


Human “bare hand” 
dexterity 


1 Km*3 coverage by 
coordinated mobile 
manipulative systems 


Dockable, modular 
multi-robot elements 
for assembly, servicing 


Long Term 


Automated planning and 
sequencing of local area activities 
(science scripts, maintenance & 
logistics functions). Multi-target 
science sorties in one command. 
Global coverage of science bodies 
through networked science assets 


Rove at will into densely featured 
and highly variable terrains at 
lunar and Mars gravi 

Mix and match modularized 
hardware-software robotic assets 
for all basic surface H/R support 
and logistical functions 


Full body emulation of human 
assembly and repair skills by 
robotic anthropmorph 

Robotically traverse complex 
space structures to perform 
planned and spontaneous 
inspection and servicing functions 
Robots and crew freely and safely 
interact both physical-cooperative 
and symbolic command i/f levels 
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NASA EXAMPLE: Capability Trends (2) CL. 


Subsurface & Aerial Access 


Autonomous Drilling/ Drilling 10-100°s em Drilling 10-20 meters Drilling 50-100 meters at Mars, 
Coring in penetrable rock, in Mars analogs. drilling for resources as needed at 
sand media; novel Automated detection Earth moon, 
arm-mounted core and mitigation of slip- 
extraction devices stick conditions 
(TRL 3-4) 
Icy Melt Exploration Cryobotic access to Self powered and Cryobotic exploration of Europan 
uniform icy media science instrumented ice fields. Deep icy soil 
(TRL 5) cryobot earth analog exploration of Mars high latitudes. 
experiment 


Powered aerobotic Titan aerobot scenario Titan aerial exploration and 
Aerial Access to Small flight over terrain of demonstrated in full possible drop-sonde and sampling. 
Bodies interest (TRL 3-4) scale earth analog 
demo 


Robotic Intelligence & H/R Interaction 


Planning & Monitoring Contingent Resources Deliberative task Integrated planning and 
Systems Planners, Local planners for well sequencing tools for ground 
Spatial Planners structured assembly operations of SSE robotic 
(TRL 4-5) tasks; automated missions. High fidelity simulation 
sequencing of basic of all aspects of planetary surface 
science routines; exploration. 
integrated spatial- 
resource planners for 
long ranging traverse 
Time Delay Control of Teleoperative Teleprogrammed High dexterity operations over 
Telerobotic Tasks preview-predictive modes of remote variable time delay from earth, 
(ground to orbit, from displays; shared control—the robot orbit, and at field sites. 
orbit to surface) compliance controls autonomously 
(TRL 3-5) sequences local task 
behaviors / primitives 
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EXAMPLE: Field Trials and Analog Missions 


Demonstrate New Capabilities and Provide Integrated V&V for Component Technologies 


Testbed Use FIDO and K9 Rover Used in MER Analog Missions 


Component technology integration and test 


Intelligent Systems (IS) and other initiatives 
technology product infusion/leverage 


—_ 


Steve Squyres in | 
Mojave Desert 


Development and verification of human/robot 
operation interfaces, planning/visualization 


Quantitative system-level performance 
evaluation & characterization 


Ground truth, field validation, and science 
community tie-ins for relevant experiments 


Advances in synergistic science operations Supporting Technology Development 
and on-board science analysis 


¢ Comprehensive control architectures for multiple, 
interacting, instrumented planetary and on-orbit 
robotic systems 


¢ On-board intelligence for automated science 
sequence planning, error handling and recovery; 
visually referenced mobility and manipulation 


* High-fidelity simulations for concept development 


P. S. Schenker, et al., “Planetary Rover Developments ¢ End-to-end capability to emulate science-relevant 


Supporting Mars Exploration, Sample Return and Future 
Human-Robotic Colonization,” Autonomous Robots, No. 


remote operations, including critical program 


2/3, March/May, Vol. 14, pp. 103-126, 2003 (Special Issue on elements of human/robot interaction & cooperation 
Robots in Space) 


EXAMPLE: Challenges to Mobile Autonomy 


autonomous 


traverse route goal 


CIFIC) : 
partial panorama 
—_ goal 


cameras & 
spectrometer 


processing and caching 
=e 


drilling & scooping 


AUTONOMOUS TRAVERSE: 

Autonomous traverse, obstacle avoidance, 
and position estimation relative to the 
starting position. 


APPROACH & INSTRUMENT PLACEMENT: 
Autonomous placement of a science 
instrument on a designated target, specified 
in imagery taken from a stand-off distance. 


ONBOARD SCIENCE: 

Autonomous processing of science data 
onboard the rover system, for intelligent 
data compression, prioritization, anomaly 
recognition. 


SAMPLING: 

Sampling, sample processing, and sample 
caching through development of controls 
for new system components. 


EXAMPLE: Technology Infusion to MER 


(from Mars Technology Program and Predecessors) 


FRevenes Pics oo | a Ome 


p Pl/Technologist 


Long Range Science Rover |NASA (Code R and MTP) _ |Provides increased traverse range of rover operations, improved traverse acuracy, landerless and Samad Hayati 
distributed ground operations with a large reduction in mass Richard Volpe 


Science Activity Planner NASA (Code Rand MTP) {Provides downlink data visualization, science activity planning, merging of science plans from multiple Paul Backes 
scientists Jeff Norris 


FIDO: Field Integrated NASA (MTP) 
Design and Operations 


Developed TRL 4-6 rover system designs, advancing NASA capabilities for Mars exploration; Paul Schenker 
demonstrated this in full-scale terrestrial field trials, Integrated/operated miniaturized science payloads of |Eric Baumgartner 
Rover mission interest, coupling terrestrial field trials to 


Manipulator Collision NASA (MTP) Computationally efficient algorithm for predicting and preventing collisions between manipulator and Eric Baumgartner 
Prevention Software rover/terrain. Chris Leger 


Descent Image Motion NASA (Code Rand MTP) __|Software and hardware system for measuring horizontal velocity during descent, Algorithm combines Andrew Johnson 
Estimation System (DIMES) image feature correlation with gyroscope attitude and radar altitude measurements. Yang Cheng 


Parallel Telemetry NASA (Code Rand MTP) {Data cataloging system from PTeP is used in the MER mission to catalog database files for the Science |Mark Powell 

Processor (PTeP) Activity Planner science operations tool Paul Backes 

Visual Odometry NASA (MTP) Onboard rover motion estimation by feature tracking with stereo imagery, enables rover motion Larry Matthies 
estimation with error < 2% of distance traveled Yang Cheng 


Rover Localization and NASA (MTP) An image network is formed by finding correspondences within and between stereo image pairs, then Ron Li 
Mapping bundle adjustment (a geometrical optimization technique) is used to determine camera and landmark Clark Olson 
positions, resulting in localization accuracy good for trav et. al. 


Grid-based Estimation of NASA (Code R and MTP) 
Surface Traversability 


Performs traversability analysis on 3-D range data to predict vehicle safety at all nearby locations; robust |Mark Maimone 
to partial sensor data and imprecise position estimation. Configurable for avoiding obstacle during long 


Applied to Local Terrain traverse or for driving toward rocks for 


Lithium-lon Batteries NASA (Code R and MTP), {Significant mass and volume savings (3-4 X) compared to the SOA Ni-Cd and Ni-H2 batteries. Richard Ewell 
Air Force (AFRL) Rao Surampudi 


“130 


Pre-decisional Draft 


Capability 10.5 
Robotics for Solar System Exploration 


Sub-Team Chair: Reid Simmons, CMU 
Presenter: Paul Schenker, JPL 
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Capability 10.5 
Robotics for Solar System Exploration 


FRevenes Pics Dacmenes Om 


¢ This capability area defines the robotic capabilities needed for both unmanned and 
manned science and exploration missions throughout the solar system. They include: 


Autonomous mobility and access (surface, aerial, and sub-surface) 
° Exploration of large regions 
° Sub-surface access (shallow, deep, ice-melt probes) 
° Access to high-risk/high-payoff sites (cliffs, canyons, craters) 
° Navigation on small bodies 
co Aerial survey 


— Autonomous instrument deployment (from landed and mobile platforms) 
° Target selection 
° Precision instrument placement 
° Data collection and validation 


— On-board autonomous science 
° Perception 
° = Analysis 
° = Planning 
° Execution 


— Human-robotic field science 
° Site mapping/survey 
° Site characterization 
° Sample acquisition (digging, drilling, scooping, trenching, etc.) 
°c Sample processing (grinding, crushing, etc.) 
° Sample handling (containment) 


— Human-robot interaction 
° Ground based teleoperation 
°  Proximate telepresence 
° $houlder-to-shoulder interaction 
° Robot assistants 
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Benefits of Capability 10.5 j , » 


Robotics for Solar System Exploration 


FRevenes Prices o Dacmenes Ome 


¢ Robotic mobility, instrument deployment, and sample access are enabling 
for unmanned planetary surface, aerial, and sub-surface exploration by 
providing access to places where human access is impossible, or would be 
too dangerous or expensive 
— go where we currently can’t—survive—do breakthrough science 


¢ Robotics and on-board autonomous science capabilities are enabling for 
long-endurance remote in-situ science operations at multiple sites, permitting 
synoptic sampling and increasing science productivity 


¢ Robotic scouts and astronaut assistants are enhancing for manned 
planetary surface exploration by replacing humans on some tasks and 
working with them on others 


— Reduction/elimination of “dirty, dull, and dangerous” tasks for humans 
— Reduction in the workloads of humans 


— Consequent reductions in mission manning levels and, therefore, in the resources 
required to support them 
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Current State-of-the-Art for Capability 10.5 J | y I 


Robotics for Solar System Exploration 
FRevancea P rencine & Heteprevien Omce 


¢ Autonomous mobility and sample access 
— MER mobility: 10-120 m/sol to commanded point with > 90% success, 
< 20 degree slopes, sparse obstacle field 
— MER visual odometry: ~2% accuracy over distance traveled 
— MER sample access: RAT, wheel scuffing of soil 
— Deep Space 2: Small, sub-surface micro probe, ~50cm access 


¢ Autonomous instrument deployment 
— MPL arm: ~2 m reach, 4 DOF, operated from fixed platform 
— MER arm: 90 cm reach, 4 DOF, operated from mobile base 


¢ On-board autonomous science 
— Human-commanded on per-sol basis 
— Fixed sequences 


¢ Human-robotic field science 
— No operational experience 


¢ Human-robot interaction 
— Sojourner/MER: Ground teleoperation 
— MER: Commanded on per-sol basis 


=> Laboratory, and some field, demonstrations of long-range navigation (< km per command cycle), 
7DOF arms, meter-deep drilling, single instrument placement, autonomous science planning and 
execution, robotic assistants, etc. 
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Robotic Autonomy, Science & Simulation 
... and the potential of “on-board (autonomous) science” ... 


Sensor, terrain-interaction, and navigational control models drive 
early operational scenario assessment and design validation 
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asa Requirements /Assumptions for Capability 10.5 
Robotics for Solar System Exploration 


FRevexes Pics 6 Dacenes Om 


¢ Robotics for Solar System Exploration in Support of Manned Missions 
— Spiral 1: 2014 Robotic Lunar Exploration 
o Ground-based teleoperation of rovers or landers 
° Exploration of large regions 
Spiral 2: 2015-2020 Lunar Surface Ops 
° Human-robot field science from Earth and Lunar surface 
° Sample acquisition and processing 
° Semi-autonomous site mapping / survey 
Spiral 3: 2020 Lunar Habitat and Mars Human Precursor 
o Proximate telepresence from lunar habitats 
° Sample acquisition, processing, and analysis 
°e Autonomous site characterization 
Spiral 4: 2025 Mars Vicinity Ops 
© Human-robot field science from orbiting craft 
° Proximate telepresence from orbiting craft of multiple rovers and landers 
Spiral 5: 2030+ Martian Surface Exploration 
° Shoulder-to-shoulder interaction 
° Robot assistants for exploration 
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asa Requirements /Assumptions for Capability 10.5 
Robotics for Solar System Exploration 


PRevancea P rancine © Htegrevien O mee 
¢ Robotics for Solar System Exploration in Support of Unmanned 
Missions 
— Lunar Surface 
° Moonrise 
Mars Surface 
° Astrobiology Field Lab 
o Mars Science Lab 
o Mars Sample Return 
Non-Planetary Surface (small body) 
° Comet Sample Return 
o Asteroid Rover Sample Return 
Mars Sub-Surface 
° Deep Drill 
Planetary Sub-Surface 
° Europa Astrobiology Lander 
— Planetary Aerial 
o Titan Explorer 
° Venus Mobile 
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Potential Pathway Mission Sequences 


FRevexes Prices 6 BD secpreten Om. 


Astrobiology 
Search for Evidence MSL to Field Lab 
of Past Life [Moderate Latitude| °COU" ia - 
Deep Drill 


Explore MSL to Astrobiology 
Hydrothermal Hydrothermal Field Deep Drill 
Habitats Deposit Laboratory 


Search for Present MeL eign 
Life Latitude or Active] Scout Scout MSR Scout 
Vent 
Explore Evolution of MSL to 
. MSR Aeronom Network t 
2005 President’s st Mars Mars 
Budget Augmentation Testbed Testbed Testbed 


Replacement 
Telecom* 


$= Pre-decisioa Dat Sa 


Missions to high- 
probability past 
habitat. Mission in ‘18 
influenced by MSL 
results. 


All core missions sent 
to active or extinct 
hydrothermal deposits. 


Missions to modern 
habitat. Path has 
highest risk. 


Path rests on proof 
that Mars was never 
wet. 


“Search for Past Life” Pathway Example 
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Challenges to Mobile Autonomy 


autonomous 
traverse route 


CIFIC) : 
partial panorama 
—_ goal 


cameras & 
spectrometer 


processing and caching 


drilling & scooping 


AUTONOMOUS TRAVERSE: 

Autonomous traverse, obstacle avoidance, 
and position estimation relative to the 
starting position. 


APPROACH & INSTRUMENT PLACEMENT: 
Autonomous placement of a science 
instrument on a designated target, specified 
in imagery taken from a stand-off distance. 


ONBOARD SCIENCE: 

Autonomous processing of science data 
onboard the rover system, for intelligent 
data compression, prioritization, anomaly 
recognition. 


SAMPLING: 

Sampling, sample processing, and sample 
caching through development of controls 
for new system components. 


asa Technologies Infusion Example: MER 


(from Mars Technology Program and Predecessors) 


FRevenes Pics oo | a Ome 


p Pl/Technologist 


Long Range Science Rover |NASA (Code R and MTP) _ |Provides increased traverse range of rover operations, improved traverse acuracy, landerless and Samad Hayati 
distributed ground operations with a large reduction in mass Richard Volpe 
Science Activity Planner NASA (Code Rand MTP) {Provides downlink data visualization, science activity planning, merging of science plans from multiple Paul Backes 

scientists Jeff Norris 


FIDO: Field Integrated NASA (MTP) Developed TRL 4-6 rover system designs, advancing NASA capabilities for Mars exploration; Paul Schenker 
Design and Operations demonstrated this in full-scale terrestrial field trials, Integrated/operated miniaturized science payloads of |Eric Baumgartner 
Rover mission interest, coupling terrestrial field trials to 

) 


Manipulator Collision NASA (MTP Computationally efficient algorithm for predicting and preventing collisions between manipulator and Eric Baumgartner 
Prevention Software rover/terrain. Chris Leger 


Descent Image Motion NASA (Code Rand MTP) |Software and hardware system for measuring horizontal velocity during descent, Algorithm combines Andrew Johnson 
Estimation System (DIMES) image feature correlation with gyroscope attitude and radar altitude measurements. Yang Cheng 
) 


Parallel Telemetry NASA (Code R and MTP Data cataloging system from PTeP is used in the MER mission to catalog database files for the Science Mark Powell 

Processor (PTeP) Activity Planner science operations tool Paul Backes 

Visual Odometry NASA (MTP) Onboard rover motion estimation by feature tracking with stereo imagery, enables rover motion Larry Matthies 
estimation with error < 2% of distance traveled Yang Cheng 


Rover Localization and NASA (MTP) An image network is formed by finding correspondences within and between stereo image pairs, then Ron Li 

Mapping bundle adjustment (a geometrical optimization technique) is used to determine camera and landmark Clark Olson 
positions, resulting in localization accuracy good for trav et. al. 

Grid-based Estimation of NASA (Code Rand MTP) {Performs traversability analysis on 3-D range data to predict vehicle safety at all nearby locations; robust |Mark Maimone 


Surface Traversability 


to partial sensor data and imprecise position estimation. Configurable for avoiding obstacle during long 
traverse or for driving toward rocks for 


Applied to Local Terrain 


Lithium-lon Batteries NASA (Code R and MTP), {Significant mass and volume savings (3-4 X) compared to the SOA Ni-Cd and Ni-H2 batteries. Richard Ewell 
Air Force (AFRL) Rao Surampudi 
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SSE SRM: Design Reference Mission Set 


[Frequency | | 6 to 7 per decade 4 per decade TBD per decade 1 per decade 


FIRST DECADE /|2003 to Kuiper Belt- Pluto Explorer 
2013 Competitive South Pole-Aitken Basin Sample Return Europa Geophysical Observer 
All solar system —_| Jupiter Polar Orbiter with probes 
targets except for | Venus in Situ Explorer - VSSR techval 
Mats Comet Surface Sample Return 
Jupiter Icy Moons Orbiter(2015) 


SECOND 2014 to 

DECADE 2023 

Primitive Asteroid Rover Sample Return Comet Cryogenic Sample Return 
Bodies Trojan Centaur Reconnaissance Flyby 


en Geophysical Network -Venus ——® |Geophysical Network Venus 
= en it a Venus M obile Mission Venus Sample Return 
7 Geophysical Network - Mercury Mercury Sample Return 


Neptune Flyby <q | Neptune Flyby with Probes Neptune Orbiter with Probes 
Neptune Triton Orbital Tour <— | Neptune Orbiter/Triton Explorer 
Giant Planets Uranus Flyby <— | Uranus Flyby with Probes} <4— |Uranus Orbiter with Probes 
Saturn Flyby with Probes <—| Saturn Ring Observer 
Jupiter Flyby with probes 


; lo Observer Europa Lander 
Large Satellites : - ; - - 
Ganymede Observer Titan Explorer (no orbiter) Titan Explorer (with Titan orbiter) 
Third Decade |2024 to Overflow from Second Decade Overflow from Second Decade 
2035 New Science driven opportunities New science driven opportunities 


Notes: 

Missions in black italics are the Decadal Survey missions. 

Missions in red bold italics are Decadal Survey missions or parts of missions that are now known to be incompatible with this mission class 
Missions in blue bold italics are New Missions that have been identified to address some of Major Mission objectives at affordable cost 
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Planetary Mobility: Today 


| Mars 
— Ability to traverse moderately rocky surfaces at 
<500m/sol 
— Vulnerable to low bearing strength deposits (sand 
and dust, particularly on slopes. 
— Many important science targets including 
craters and tock outcrops involve a significant 
tisk of the rover getting immobilized . 


Titan 
— Demonstration of key technologies to survive in 
the cold environment of Titan (FY03-05 R&TD). 
— Initial test bed investigations of autonomy for 
Titan. 
— Not yet at a point that NASA could commit to 
a Titan in situ mission. 


Venus 
— Capability to circumnavigate Venus by high 
latitude balloon (e.g. JPL VALOR proposal to the 
2004 Discovery call) 
— Near surface metal bellows balloon demonstrated 
in R&TD topic proposal in 2004 
— No other current NASA work on mobile near 
surface exploration of Venus. 
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@ Planetary Mobility: Vision 


~ m > [ — 
> Mars Surface Mobility 


— Increase speed of travel by a factor of 20 and 
covert 100 km in three months 


ee — Reduce power needed for locomotion by a factor 
Endurance Crater's ling Dunes (August 6200 of three. 


— Traverse dunes, dust deposits, large boulders and 
steep slopes with equal facility 

— Access rock outcrops above talus slopes at the 
angle of repose. 


Titan Aerial Exploration 
— Circumnavigate Titan and acquire 1000X the 
image data obtained by Huygens at high S/N 
— Descend tepeatedly to the surface of Titan to 
image fluvial and cryovolcanic features up close 
— Acquire touch and go samples from selected 
targets on the Titan surface and perform in situ 
Huygens at Titan, Jan 17 2005 analysis. 
. == : eer 


Venus Aerial Exploration 
— Citcumnavigate Venus and acquire 10,000 times 
the image data obtained by Venera 9-14 
— Descend repeatedly to the surface of Venus and 
perform in situ analysis. 
— Survive for several months in the Venus near 
surface environment . 


Driving 


AR&C 
Capabilities 


Deliverables for Capability 10.5 
Robotics for Solar System Exploration 


2 Mars Con X poe 

< : 2012 on Sample i 

8 (2009) Science Ce i) (2014) ata as 4 

uv Lunar Lab Lunar (2014) Mars ars Human 

= Recon a A Sample aaa Astrobiology Ereeursos 
Orbiter eae Return a Field Lab 


Be : ‘On-Board Science 
Autonomous Mobility Autonomous Mobility © ‘Human- Robot 
and ACCOSs : and Access : i Interaction 

; Autonomous Instrument : Autonomous Instrument 
Deployment Deployment 


10.5.1 Exploration of Large 
Regions CRL7 : 
(Spiral 1) : 


GRL 7: : 
(Spiral ae Rough Terrain) 
10.5.2 Sub-Surface Access - - - 


Shallow Trenching ae ie sf 
; eep Dri 


10.5.3 Aerial Survey 


CRL7 
Balloon vs. Blimp (Aciubon 
10.5.4 Autonomous Instrument i or : E 
Deployment ARs : 
AFL : : 
10.5.5 On-Board Autonomous oe eee 
Science SSS 
CRL7 : 
10.5.6 Human-Robotic Field on 
Science : 
10.5.7 Proximate Telepresence O_O 
CRL7 : 
10.5.8 Shoulder-to-Shoulder Spiral?) 
Interaction 
Co: Modaliti 
mm. odahties (Spiral 2) 
Enhancing/ | 
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Driving 
Missions 


AR&C 
Capabilities 


Deliverables for Capability 10.5 
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Robotics for Solar System Exploration } ; 4 


Mag Constellation Spiral 3 Titan Aerobot Planet Imager : 
A A Spiral 5 
: : F A 
Mars Deep Drill Mars Airplane: Venus Aerobot : Saties See Spiral 4 Europa Cryobot *~ 5 
: : Return AAA Hee 


On-Board ‘Human- Robot Human-Robot 


Autonomous Mobility eee : Science ‘Field Science : Field Science 
anda” Autonomous : A t omous ; : 
: Autonomous Mobility and Access uton i A 
sai Z Instrument ce ‘Robot Mobility ie peas 
Deployment : peetaction and Access a sree 


10.5.1 Exploration of Large 
Regions 


10.5.2 Sub-Surface Access 4 i i : 
: : : CRL7 
(Cryobot — Melt Probes) 


10.5.3 Aerial Survey 


CRL7 
(Aerobot) 

10.5.4 Autonomous Instrument HOH ra 
Deployment ioe a 
Ou Pb: Pf 

10.5.5 On-Board Autonomous a  : 
Science CRL? cere 
(Spiral 4) (Spiral 5) zi ns 


10.5.6 Human-Robotic Field ei ie 
Science ———— 
CRL7 CRL7 
10.5.7 Proximate Telepresence jspushy) gu) 


10.5.8 Shoulder-to-Shoulder a 


Interaction 
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¢ Exploration of large regions 
— Driver: Spiral 1 (Lunar); Spiral 3 (Mars) 
— CRL 7 date: 2009 
— Interfaces: 6-RAPS, 9-HESM 
¢ Sub-surface access 
— Drivers: Deep Drill, Europa Astrobiology Lander 
— CRL 7 date: 2013 
— Interfaces: 6-RAPS 
¢ Aerial survey 
— Drivers: Titan Explorer, Venus Mobile 
— CRL 7 date: 2015 
— Interfaces: RAPS 
¢ Autonomous instrument deployment 
— Driver: Astrobiology Field Lab, Mars Human Precursor 
— SMD -TRL6- 2013 
— Interfaces: 12-SI/S 
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Deliverables for Capability 10.5 
Robotics for Solar System Exploration 
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¢ On-board autonomous science 
— Driver: Astrobiology Field Lab 
— CRL 7 date: 2013 
— Interfaces: 12-SI/S, 6-RAPS 
¢ Human-robotic field science 
— Driver: Spiral 4 and 5 (Mars) 
— CRL 7 date: 2020 
— Interfaces: 6-RAPS,12-SI/S, 9-HES&M 
¢ Proximate telepresence 
— Driver: Spiral 2 (Lunar); Spiral 4 (Mars) 
— CRL 7 date: 2010 
— Interfaces: 9-HES&M, 8-HH&SS 
¢ Shoulder-to-shoulder interaction 
— Driver: Spiral 5 
— CRL 7 date: 2025 
— Interfaces: 9-HESM, 8-HH&SS 
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Capability 


Exploration of Large 
Regions 


Sub-Surface Access 


Aerial Survey 


Autonomous Instrument 
Deployment 
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Technology 


Autonomous Navigation 

Localization 

Path Planning 

Rough-Terrain Navigation 
(hills, cliffs, craters, etc.) 


Shallow Trenching 
Deep Drilling 
Melt Probes 


Real-Time Adaptive Control 
Real-Time Control in 3D 
Path Planning in 3D 


Target Detection 

Precision Placement 
Dexterous Robotic Arms 
Data Collection & Validation 


Current 
CRL 


3-5 


2-5 


2-4 


Maturity Level - Capabilities for 10.5 
Robotics for Solar System Exploration 


Required 
CRL 


6 


FRevenes Prices ob Dasasrenes On. 


Driver 


Spiral 1 — 
Lunar 
Exploration 


Spiral 3 — Mars 
Exploration 
Deep Drill 
Europa 
Astrobiology 
Lander 

Titan Explorer 
Venus Mobile 


Astrobiology 
Field Lab 
Mars Human 
Precursor 


Need 
Date 


2009 


2013 


2015 


2013 
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Capability 


On-Board Autonomous 
Science 


Human-Robotic Field 
Science 


Proximate Telepresence 


Shoulder-to-Shoulder 
Interaction 
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Technology 


Target Detection 
On-Board Classification 
Robust State Estimation 
Task Planning 


Autonomous Navigation 
Target Detection 
On-Board Classification 
Sample Acquisition & 
Processing 


Remote Teleoperation 
Dexterous Robots 
Safeguarding 

Sliding Autonomy 


Multi-Modal Communication 
Behavior Recognition 
Safeguarding 

Task Management 


Current 
CRL 


2-4 


3-5 


2-3 


Maturity Level - Capabilities for 10.5 
Robotics for Solar System Exploration 


Required 
CRL 


6 
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Driver 


Astrobiology 
Field Lab 


Spirals 4 & 5— 
Mars 
Exploration 


Spiral 2 — 
Lunar 
Exploration 
Spiral 4 — Mars 
Exploration 


Spiral 5 — Mars 
Exploration 


Need 
Date 


2013 


2020 


2010 


2025 


Technology 


Autonomous 
Navigation 


Perception of Geologic 
Features 


Sample Acquisition 


Sample Processing 
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Components 


Long Range Navigation 


Localization 
Path Planning 


Rough Terrain Navigation 


Target Detection 
On-Board Classification 


Precision Placement 
Dexterous Robotic Arms 
Scooping 

Coring 


Crushing 
Containment 


Candidates 


Stereo-based local 
obstacle avoidance 

Visual odometry 

Heuristic, resource- 
cognizant search 

Dynamics-based 
planning 


SIFT, PCA-SIFT 
Neural net, Bayesian 
classifier 


Visual Servoing 
Robonaut, Ranger 
5 DOF Arm 


? 
? 
? 


Maturity Level — Technologies for 10.5 
Robotics for Solar System Exploration 


Current 
TRL 


6-9 


6-9 
4-6 


2-4 
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Key Gaps 


Obstacle 
density 


Computational 
complexity 

Complexity, 
modeling 


Robustness 
Data volume, 
scalability 


Robustness 
Reliability 


Power 
Validation 


Need 
Date 


2009 


2013 


2013 


2013 
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Maturity Level - Technologies for 10.5 
Robotics for Solar System Exploration 
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Technology Components Candidates Current Key Gaps Need 
TRL Date 
Real-Time Adaptive Non-linear control 3-6 Modeling 2015 
Control Fuzzy control 3-4 
Robust State Kalman Filters 6-9 Accuracy, 2013 
Estimation Particle Filters 3-5 modeling 
Task Planning Planning/scheduling 5-7 Complexity, 2013 
Contingent planning 4-6 modeling 
Decision-theoretic planning 2-4 
3D Planning and Probabilistic roadmaps 3-5 Complexity, 2015 
Control Non-linear control, fuzzy 3-6 modeling 
control, memory-based 
learning 
Teleoperation Direct teleop 6-9 Validation, 2010 
Teleop with local behaviors 5-6 scalability 
Behavior Recognition | Tracking SIFT, PCA-SIFT 3-5 Robustness 2020 
Interpretation HMMs, Cognitive models 2-3 
Task Management Executive Procedural decomposition 4-6 Validation 2020 
Planning/scheduling 5-7 Modeling 
Multi-Modal Speech HMMs, Natural language 5-7 Robustness 2025 
Communication Gesture HMMs 2-4 
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reakthrough Capabilities for 10.5 
Robotics for Solar System Exploration 
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oe -Planetary Vehicle 


Current rovers are limited to exploring small sections of relatively benign terrain. 
However, the most interesting science sites lie in relatively inaccessible and 
inhospitable locations (on the sides of cliffs/craters, up in the mountains, in deep 
valleys). It would be a breakthrough in robotic exploration to have rovers that 
could go essentially anywhere on a planet that the scientists want to go. Besides 
the obvious need for advances in mobility, this capability would require significant 
advances in perception, planning, control, and monitoring and safeguarding. 


Self-Aware, Self-Correcting Robots 


By its very nature, exploration involves dealing with the unknown and unexpected. 
Current robots have limited capabilities for understanding when they are outside 
their limits and, if they are, how to get back to nominal mode of operations. This 
is especially apparent when things go wrong internal to the robot (such as sensors 
or actuators malfunctioning). It would be a breakthrough in robotic exploration to 
have a capability that monitors the robot at all times for these situations, recovers 
(or compensates for) such failures, and learns from past mistakes to avoid making 
them in the future. 
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Metric 


Distance traveled per day 


Difficulty of terrain that is 
accessible 


Drilling depth 


Autonomously controlled 
manipulator degrees of freedom 


Command cycles per sample 
acquired 


Command cycles per sample 
processed 


Command cycles to 
survey/characterize site 


Percent of interactions 
interpreted correctly by robot 


# robots supervised per human 
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etrics for 10.5 


Technology / 
Sub-Capability 


Autonomous Navigation 
Aerial Traverse 


Autonomous Navigation 


Sub-Surface Access 


Instrument Placement, 
Human-Robot Interaction 


Instrument Placement, 
Field Science 


Field Science 
Field Science 


Multi-modal communication 
Behavior tracking 


Human-Robot Field Science 
Co-located Interaction 


Robotics for Solar System Exploration 


SOA 


100m 
1km 


VL1 


10’s cms 


7 


Target 
Value 


1km 
10km 


>VL2, cliffs, 
craters 


10-20 ms 
10’s 


- Yn i 
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Need Date 


2009 
2015 
2015 


2013 
2020 


2009 


2013 


2020 


2020 


2020 
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Traversesability (relative to rock area density) 


JP. EXAMPLE: Rover System Capability Metrics 


} : Tethered crater : ‘ 
Limbed excursion robot for surface desacra Extensible cooperative 


and space structures — has ~\. multi-robot work 
changeable end effector 


Cliff- sensing/tooling 
hanger) =" = ce ee . 
ai CliffaBot= 5) 
70+ degree navigable a = 
cliff descent / ascent Autonomous urban 
recon rebot 15%G,.1.5 meter 


wheel, 50 cm/sec 


~ Inflatable 
q So 


50% 
s| ope Reconfigurable rover, 
40- 50 degree slope 
access (in simulated 
sample cache transfer) 


7 Kg, 1 meter footprint, 
composite construction, 


a « lightweight rover 1 - 3 commands / 
VL2 Self-righting ops cycle 
2 kg rover 3 - 10 commands / 
ops cycle 
10 + commands per 
operational cycle 
VL1 
1 10 100 1000 10000 


Mobile Robot Range (meters) 


Backup slides follow 
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Robotics for Solar System Exploration 


Exploration of Large Regions 


¢ Effective robotic exploration will require autonomous navigation over wide areas 
(10’s of kms) with diverse features (hills, craters, dense obstacles). Rover plans 
to distant goals, executes those plans, and keeps itself safe by Knowing where it 
can, and cannot, go. (Some risk in rough terrain) 


Sub-Surface Access 


¢ Direct evidence of water and past life is likely to be found beneath the surface. 
Access and sample acquisition will be required at shallow depths (10’s of cms), 
deep depths (10’s of ms) and through thick ice layers (100’s of ms). (Risk for 
deep drilling) 


Aerial Survey 


¢ For some missions, aerial vehicles (balloons, blimps, airplanes) are enabling 
because either surface access is impossible or access is required to a much 
larger area than can be covered by ground vehicles. Control for aerial vehicles is 
much more complex than for ground vehicles, due to the dynamic effects of the 
(poorly understood) atmosphere and the need to navigate in three dimensions. 
(Some risk) 
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eliverable Descriptions for Capability 10.5 
Robotics for Solar System Exploration 
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Autonomous Instrument Deployment 


Current missions require multi-day, highly complex command cycles to approach 
and place instruments on targets of interest. Handling this autonomously is 
extremely enhancing, especially for remote, long-duration missions. This requires 
advanced sensor-guided dexterous manipulation for precision placement and 
advanced techniques for autonomously collecting and validating instrument data. 


On-Board Autonomous Science 


This capability considers larger scientific goals, such as what in an area is of 
scientific interest, which experiments are most relevant to characterize that site, 
and how to carry out those autonomously experiments. Dealing with high levels 
of uncertainty in state estimation and task planning is critical, as is having highly 
flexible, contingent plans to deal with the unexpected. 


Human-Robotic Field Science 


Field science includes site survey, site characterization, science data collection, 
and sample acquisition and processing. For complex, remote missions, 
automating many of these activities will be highly enhancing. To perform such 
tasks autonomously, robot systems will need a basic understanding of the 
methods and goals of scientific investigation, as well as the capabilities to 
perceive, plan, and execute such plans. Advanced manipulation capabilities for 
sample acquisition and processing will be critical. (Some risk) 
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Deliverable Descriptions for Capability 10.5 ' J I 


Robotics for Solar System Exploration 


Proximate Telepresence 


In many missions, the humans will be near the robots but will be supervising them 
from a safe distance (e.g., in a habitat or on orbit). To facilitate the interaction, 
the robots should have capabilities similar to humans (especially in terms of 
manipulation) and the level of control between robots and humans should be 
highly flexible (“sliding autonomy”). Situational awareness of the supervisor needs 
to be high, which can be facilitated with both multi-modal feedback and high-level 
interpretation (by the robot) of sensor data. Safeguarding to prevent harm to the 
robots is critical. 


Shoulder-to-Shoulder Interaction 


In some missions, humans and robots will be co-located on site, working 
together. At a basic level, the robots will need to understand and communicate 
with the astronauts using both speech and gesture. In addition, in many cases 
they will need to infer (without communication) the behaviors and intentions of the 
astronauts and alter their activities accordingly to support the astronauts’ goals. 
Safeguarding to prevent harm to the humans is critical. (Some risk) 
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Capability 10.6 
Robotics for Lunar and Planetary Habitation 


Sub-Team Chair: Illah Nourbakhsh, NASA/ARC 
Presenter: Paul Schenker, JPL 
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Capability 10.6 
Robotics for Lunar and Planetary Habitation 
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¢ Robotic capabilities are instrumental to preparing for human habitation, 
maintaining surface habitats, providing support for human surface 
operations both in-habitat and in the field, and aiding in the collection of in- 
situ resources for human habitation. 


¢ Robotic capabilities in lunar and planetary habitation make long-term 
habitation feasible by greatly reducing risk and cost. 


¢ Specific sub-capabilities include: 
— Site development (survey, excavation, initial construction, resource deployments) 
— Site maintenance (inspection, repair, assembly, materials transport & warehousing) 
— In-situ resource production (robotic support to extraction, transport, manufacturing) 
— Field logistics and operations support (materials & equipment transport & warehousing) 
— Human-robot interaction (H/R task allocation, teleoperation, remote supervisory control, etc.) 
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Robotics for Lunar and Planetary Habitation 
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¢ Robotic ISRU, robotic precursor preparation and ongoing robotic 
mission support are enabling for length of stay targets and 
operational cost targets due to impact on sustainability and 
affordability. 


¢ Human safety is enhanced through precursor robotic site 
preparation. 


¢ Field operations productivity is enhanced through robotic “mule” 
support and robotic mobile communication networking. 


¢ Astronaut productivity is enhanced by lowering maintenance and 
inspection overhead assigned to human crew. 


¢ Ground-crew interaction productivity is enhanced by improved 
human-robot interfaces. 
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Summary State-of-the-Art for Capability 10.6 ) | ] 


Robotics for Lunar and Planetary Habitation 
PRevancea P raneine © Eategretion Orne 
¢ Robotics has not been used for lunar or planetary habitation. 
Related state-of-art capabilities demonstrated in flight are: 
— MER_Long-range navigation, 10M+ navigation 


¢ State-of-art can be indirectly measured from sub-capabilities 
with terrestrial deployment, TRL6 and below: 


— Site development: Autonomous robotic excavation and site shaping has 
been demonstrate by joint CMU — Caterpillar front loader system. 


— Site development: Communication infrastructure deployment by various 
university research groups in the DARPA Centibots program has set up 
networks using robot teams in unexplored urban areas. 


— Site maintenance: Dexterous manipulation under teleoperation has been 
demonstrated in analog environments by both Ranger and Robonaut 
research teams with astronaut glove-level dexterity and 6x slowdown. 


— Field logistics and operations support: Long-distance autonomous 
navigation has been demonstrated on the order of 100km total distance 
traveled. 


— Field logistics and operations support: Architectures for perception, 
planning and control have demonstrated efficacy in Mars-analog tests at JPL 
and Ames. 


— Human-robot interaction: No identified sub-capability has demonstrated 
significant present-day success. 
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Requirements /Assumptions for Capability 10.6 } ; ] 


Robotics for Lunar and Planetary Habitation 


Manned Missions 


Spiral 2: 2015-2020 CEV LLO and EVA lunar surface ops 


Robotic precursor surface operations 


© Spiral3: 2020 Lunar surface habitat 
Human/Robotic habitat preparation, maintenance and repair 
Human/Robot field operations and ISRU experiments 


© Spiral 5: 2030+ Martian surface habitat and exploration 
Human/Robotic habitat preparation, maintenance and repair 
Human/Robot field operations and ISRU 
Un-manned Missions 
o Lunar robotic missions 2016 
o Mars ISRU experiment: 2017 
o Mars precursor missions for habitat construction 2025+ 


Assumptions 


° Human habitation drives primary ISRU need due to requirement for 
sustainable presence 


° Cost and safety arguments will necessitate human-robot teaming and 
thus human habitation suggests human-robot joint efforts 


° Habitation is long-term, not for 6 hours only but days and weeks 
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Driving 
Missions 


AR&C 
Capabilities 


10.6.1 


10.6.2 


10.6.3 


10.6.4 


Deliverables for Capability 10.6 »S 
Robotics for In-Space Operations , 


(2015) (2017) 
aes Spiral 2 Lunar Mars ISRU 
ees Sunes One Experiment 


A 


4 


Integ. planning & 
execution; reliable 


ISRU Facility mgmnt 
A 


behaviors; long-range nav _—‘ Terrain shaping Ske Survey & SIFT i Ree 
A A Bea eit : Terrain:shaping, 
i : : Visualization facilit: 
Agent-based Hunjan-robot Dexterous manipulation ari ne ant 


Interface Architectures teleép interfaces 


Adjustable autonomy, visualization 


Human-robot interaction a 
for human supervision 


Field logistics and Networking, robotic access, 
operations support long-distance nav, planning 


Excavation, facility setup 


Robotics for ISRU ISRU system management 

Site development and Site survey, manipulation 

maintenance defect detection, etc TRL 3-5 CRL7 
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Driving 
Missions 


AR&C 
Capabilities 


10.6.2 


10.6.3 


10.6.4 


Deliverables for Capability 10.6 
Robotics for In-Space Operations 


Spiral 3 Lunar Spiral 5 Mars 
Surface Habitat Surface Habitat 
a A 


Integ planning & Long-distance human-robot 
execution; Reliable robot collaboration; Long-duration 
behavior; Long-range ISRU management; Site survey; 


navigation; ISRU Dexterous manipulation 
experiment robotics interaction 


Human-robot interaction eS ey 


Field logistics and a CCCCCtC__t“E _____g 
operations support : ’ 
Robotics for ISRU Bo 


Site development and 


maintenance 


Enhancing/ | 
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— Human-robot interaction, including adjustable autonomy and visualization for 
human supervision 
o Driver: Spiral 2 (Lunar Lander, Surface Ops), 2015 
0 CRL 7 date: 2008 
o Interfaces: 6-RASP 


— Field logistics and operations support, including networking, robotic access, 
long-distance navigation and planning, etc. 
° Driver: Spiral 2 (2015) and Spiral 3, Lunar surface habitat 
0 CRL 7 date: 2010 
o Interfaces: 6-RASP and 5-Communication and Navigation 


— Robotics for ISRU, including excavation, facility setup, and ISRU system 
management 
° Driver: Spiral 2 (Lunar Lander), 2015; Mars ISRU Experiment, 2017 
° CRL 7 date: 2012 
° Interfaces: 13-ISRU 


— Site development & maintenance, including site survey, manipulation, defect 
detection, etc. 
o Driver: Spiral 2, Surface Ops and Spiral 3, Lunar/Mars surface habitat (2020) 
° CRL 7 date: 2015 
° Interfaces: 9-HES&M 
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PResexes F*, 
Human-robot interaction, including adjustable autonomy and visualization for human 
supervision 
° Humans must operate and supervise robotic and human-robot team systems, from direct robot 
teleoperation in close quarters and over long distance to remote supervisory strategic 
commanding and guidance, including human/robot task allocation, flexible multi-team member task 
allocation, adjustable autonomy, and supervision of work crews. 


Field logistics and operations support, including networking, robotic access, long- 
distance navigation and planning, etc. 

° In order to enable material transport, refueling, equipment transport, long-distance exploration, 
field science and other activities, technology must enable mobile networking, remote telepresence 
for mixed local-remote exploration and science teams; robotic access to otherwise inaccessible 
extreme terrain, autonomous planning, execution and control for long-distance and long-term 
operations and intelligent energy management for hybrid power systems. (Moderate risk) 


Robotics for ISRU, including excavation, facility setup, and ISRU system management 


° Robotics will play a critical role in supporting both precursor and ongoing activities for ISRU, 
including facility setup (piping setup, tracking assembly, site preparation); site terrain shaping and 
excavation for both teleoperated and autonomous robotic team large-scale excavation / terrain 
shaping; and system-level ISRU feedback, maintenance, inspection, adjustment and control. 

(High risk) 
Site development & maintenance, including site survey, manipulation, defect detection, 
etc. 


° From initial site survey, initial construction and resource deployments and collection to ongoing 
inspection, repair and regular maintenance operations, robotics will provide support for site 
development and long-term maintenance. Robotic technologies will include dexterous 
manipulation, perception, resource collection and warehousing control, site clean-up, site survey 
and visualization and visualization, parts collection and preparation for construction, 
communication and navigation infrastructure deployment. (High risk) 
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Lunar and Planetary Habitation 


asa Breakthrough Capabilities for Robotics for } 
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Visual learning and recognition 


Although advances in vision are consistent and of great practical use, especially 
recent object recognition work in the vein of spatially invariant feature detection, 
breakthrough advances in the areas of visual recognition of human-made and 
natural objects across extreme environmental variation, coupled with /earning, 
enabling fielded humans to explain and identify what characteristics to look for 
and how to categorize what is seen for interpreted perception, would significantly 
lower the cost and risk associated with robotic inspection and robotic manip- 
ulation of structures. This capability has the potentially to trigger one to rethink 
the costs of long-duration stays on the moon and on Mars. 


Robotic tactile dexterity 


Best forecasts will project that robotic dexterity will approach that of a EVA-suited 
human in the near future. If revolutionary advances in robotic tactile, feedback- 
based manipulation enable human naked hand-level dexterity and specific energy 
with human-level tactile feedback, this would completely change the regime of 
tasks that will be performed by robots during surface habitation activities. This 
revolutionary progress, requiring both changes in muscle motor technology and 
surface sensing technology, would dramatically lower the cost of in-space and 
surface assembly and maintenance activities by more than an order of magnitude. 
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Sub-Capability Technology Current CRL Required Driver Need 
CRL Date 
Site development & Site Survey & 3-5 6 Spiral2 2015 
maintenance Visualization 
SIFT-based Visual 3-5 6 Spiral2 2015 
detection 
Site maintenance SIFT-based Visual 3-5 6 Spiral2 2015 


defect detection 


Field logistics & operations Integrated 2-4 6 Spiral 2010 
support planning & 2,3 
execution systems 
Reliable Atomic 2-5 6 Spiral 2010 
Robot Behaviors 2,3 
MER long-range [+] 6 Spiral3 2025 


rover navigation 
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Sub-Capability Technology Current CRL Required Driver Need Date 
CRL 


Human-robot interaction Agent-based 4 6 Spiral 2 2008 
Human-Robot 
Interface Arch.’s 


Dexterous 4-5 6 Spiral 2 2008/2012 
manipulation teleop 
interfaces 
Robotics for ISRU Terrain Shaping 2-5 6 Spiral 2, 2010/2010 
Mars + 
ISRU exp 
Facility setup, ISRU 2-3 6 Spiral2, 2012 
management Mars 
ISRU exp 
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Technology 


Integrated Planning & 
Execution Systems 


Agent-based Human-Robot 
Interface Architecture 


Reliable atomic robot 
behaviors 


Terrain shaping 


Site Survey and Visualization 


Vision-based defect detection 
and Object recognition 


Dexterous manipulation 
teleoperation interfaces 


Long-range autonomous 
navigation 
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Components 


Architecture, Dialogue 


handling, Comm. 
Network 


Sensor and actuator 
logic 


Excavation, soil 
planning, handling 


Safe approach, 
tracking, planning 


Object modeling, 
training, tracking 


Candidates 


Three-tiered planning, 
sequencing and 
executive systems 


KQML message- 
passing semantic 
protocols for agent 
interoperation 


Numerous in research 


Scanner-based topology 
modeling and scanning 
plus force-controlled 2 
DOF excavation 


Single cycle instrument 
placement 


Spatially invariant visual 
feature tracking 


Human-level high DOF 
teleoperation robots 


Visual odometry-based 
closed loop navigation 


Maturity Level - Technologies for Capability 10.6 
Robotics for Lunar and Planetary Habitation 


Current 
TRL 


2-5 


4-5 


2-5 


4-5 


5-6 


3-5 


4-6 


5-6 
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Key Gaps 


Flexibility, Scale 


Field trialing 


Robustness, 
Predictability 


Robustness, 
field trialing 


Remote site 
broad survey 


Robustness, 
illumination 


Control lag, 
robustness, cost 


Workload 


Need 
Date 


2010 


2008 


2010 


2010/ 
2020 


2015 


2015 


2012 


2020 
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Metrics for Capability 10.6 


Robotics for Lunar and Planetary Habitation 


Metric 


# human interventions 
per task 


Structural connections 
per hour 


Average distance 
navigated per human 
intervention 


Proportion of navigation 
goals achieved 


% reduction of human 
cognitive load 


Maximum parallel human- 


robot supervisions 


Cubic meters excavation 
per hour 
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Technology / 
Sub-Capability 


Site development & 
maintenance 


Site development 


Field logistics and 
operations support 


Field logistics and 
operations support 


Human-robot interaction 


Human-robot interaction 


Robotics for ISRU 


SOA 


Target 
Value 
Fig of 
Merit 


<3 


> 30 


1000m+ 


FRevexes Prices ob | a On. 


Need Date 


2012 


2015 


2020 


2020 


2008 (OASIS) 


2020 (Mars) 


2015 
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Capability 10.7 
Robotics for In-Space Operations 


Sub-Team Chair: Ron Diftler, NASA/JSC 
Presenter: Paul Schenker, JPL 
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Robotics for In-S 
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¢ This capability area defines the robotic systems needed for 
assembly, inspection and maintenance, and human-robot 
interaction in space. This includes: 


¢ Assembly 
— Mass Manipulation (large, medium, small, fragile) 
— Preparation (Unpack, Identify, Order, ... ) 
— Connecting ( Align, mate, verify) 
— Self Assembly (deployment, docking, etc..) 


¢ Inspection 
— Structural (Mechanical Damage, Air Leaks, Deterioration) 
— Access ( Under Thermal Blankets, Delicate Surfaces, Confined Space locations) 
— Component/System Failure Detection (Fault Detection, Non- Destructive Eval) 


¢ Maintenance 
— Mass Manipulation (Medium, Small) 
— Locomotion (moving to points along fragile structures) 
— Staging, (Protection Removal, Temporary Stowage, Connector removal, etc...) 
— Human Rated Interface Manipulation (Crew and Robots use same interface to manipulate objects) 
— Dexterous Manipulation 


¢ Human-robot interaction 
— Multi-agent teams (Assistants, Surrogates) 
— Intent Communication (Feedback, Task Verification, ...) 
— Time Delay Compensation 
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Benefits of Capability 10.7 ) yy} 


Robotics for In-Space Operations 
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¢ |In-Space Robotics assembly is enabling for building 
exploration systems too large for single launch — solar tugs, large 
telescopes, space stations, etc... 


¢ In-Space Robotic Inspection is enabling for reducing crew 
workload, thereby reserving crew time for science and 
exploration and for providing more precise results. 


¢ In-Space Robotic Maintenance is enabling for reducing crew 
workload, thereby reserving crew time for science and 
exploration. 


¢ Additional benefits: 
— Reduced EVAs ~> Increased Safety, Reduced crew Health issues 
Enhancing the option for nuclear operations 
More options from an operations standpoint, i.e., Minuteman 
— Support unmanned CEV, Ground control operations 
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Robotics for In-Space Operations 
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¢ The state of the art for robotics for In-Space Operations ™ 
includes the Shuttle Arm, Station Arm, Japanese ETS VII 
arm, ROTEX, MFD, Inspector, XSS-10, AERCam/Sprint, 
Charlotte. 
— Simple end-effectors requiring dedicated robotic interface 
— Operational target based vision systems 
— Experimental force sensing. 
¢ The state of the art for In-Space Robotic Control Operations: 
— SRMS release and capture of satellites - Bread and Butter 
— Teleoperation and ground control, 
— Stored sequences for control mode. 
— Single Arm manipulation 
— Limited time delay compensation for USA 


— ROTEX — autonomous capture of ball via ground control — IVA 
Experimental Flight 


— Supervised Autonomy work performed by Japanese: ETS-VII — 
Experimental flight 


° Worked with Significant time delay 
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Pevancea P 
¢ The state of the art for In-Space Robotic Assembly: 
— SRMS and SSRMS work horses — Manual Control 
— Proven Large Mass Manipulation - ISS 
¢ The state of the art for In-Space Robotic Inspection: 
— Surface Inspection Only 
— Human visual inspection through robotic cameras 
— Japanese MFD/Shuttle experiment - surface flaw detection 
— AERCam/Sprint Experiment — visual data 
— Ground Control starting for SSRMS 
¢ The state of the art for In-Space Robotic 
Maintenance: 
— All experimental — task board — ETS VII 
¢ The state of the art for Human/Robot Teams: 
— Crew Positioning using Shuttle, Station arms 
— Release and re-capture of free flyer AERCam/Sprint 
— Human finalizing mating after arms dock large payloads 
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Above: flight 
Below: R&D 
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In-Space Robotics in Support of Manned Missions 
> Spiral 1: 2014 CEV LEO 


= Robotic Inspection 
» Robotic Maintenance 


o Spiral 2: 2015-2020 CEV LLO and EVA lunar surface ops 


= Robotic Assembly of Lunar Vehicles 
= Robotic Inspection and Maintenance of Lunar vehicles 
= Multi-Agent Teams 


o Spiral 3: 2020 Lunar surface habitat 


= Robotic Maintenance of In-Orbit Systems 
= Space Solar Power Plant 


° Spiral 4: 2025 Mars transit and vicinity ops 
= Robotic Assembly of Mars Vehicles 
# Robotic Inspection and Maintenance of Mars vehicles 


° Spiral 5: 2030+ Martian surface habitat and exploration 
" Robotic Maintenance of In-Orbit Systems 
= Space Solar Power Plant 
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asa Requirements /Assumptions for Capability 10.7 
, Robotics for In-Space Operations 


— In-Space Robotics in Support of Unmanned Missions 


° Observatories 
= Robotic Inspection and Maintenance for Telescopes 
= LEO - 
= GEO - 
» L1- 
» L2-—SAFIR -2016, Observatories > 10 Meters - 2020 
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Deliverables for Capability 10.7 | ) 


Robotics for In-Space Operations é 


Mars 


as 2012 Con X Sample : 
es (2009) rela (2014) Retum o eal? 
az Lunar Lunar (2014) Mars 4 — (2018) 
= Recon Sample Spiral 1 Astrobiology SAFJR 
Orbiter Return P Field Lab : 4 


Lunar Vehicle 


CEV Inspection Assembly Capability : 
Capability Lunar Vehicle ga FIR Moi 
3 Maintenance 


Capabijr 


Capability 


AR&C 
Capabilities 


Mass Manipulation 


10.7.1 Assembly 


Connectin, (Spiral 2) 4 


Structural Inspection 


Inspection Access : ) —____—_______________(\ 


CRL7 
(Spiral 1) 


10.7.2 Inspection 


ystem Inspection 


Dexterous Manipulation/ 
Uiman Rated Interface 
Manipulation 


CRL7 
(Spiral 2) 


10.7.3 Maintenance 


Staging 


CRL 7 


: _ . : ; Enhancing/ 4 Ready to Use as, 
© Major Decision A Major Event / Accomplishment / Milestone Evoliitionary :  (TRL6) —— 183— 


Driving 
Missions 


AR&C 
Capabilities 


Mars Deep Drill 


10.7.1 Assembly 


10.7.2 Inspection 


F Mass Manipulation/Locomotion 
10.7.3 Maintenance For Gossamer Structures 


Robotics for In-Space Operations 


>10M 
Obseryatories 
Mag Constellation Spiral 3 Titan Aercbot Planet Imager 
Mars Airplane Venus Aerobot eas SoTL Spiral 4 


Assembly and Maintenance 
of >10 M Observatories 


CRL7 


Europa Cryobot 


Deliverables for Capability 10.7 rt ) 


® Major Decision 


Enhancing/ 
Evolutionary 


A Major Event / Accomplishment / Milestone 


Ready to Use 
(TRL 6) 
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— Inspection (internal, external, automated, sniffers) 
o Driver - CEV 
o Spiral 1-—TRL6 - 2009 
o IST, ATO 
— Access for Inspection 
co Driver — CEV (Nozzles, panels, bays, radiators) 
oc Spiral 1-— TRL6 - 2009 
o IST, ATO 
— Connecting (Align, mate, verify, all power, fluid systems not just 
docking) 
° Driver — Assembly of Lunar Vehicles 
o Spiral 2-—TRL6 - 2010 
o IST, ATO 
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Deliverables for Capability 10.7 
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Dexterous Manipulation/Human Rated Interface Manipulation 
° Driver — Maintenance of Lunar Vehicles 
co Spiral 2-— TRL6 - 2010 
°o IST, ATO, HESM 
Staging (Protection Removal, Temporary Stowage, Connector 
removal, etc...) 
o Driver —SAFIR Telescope Maintenance 
co Other— TRL6 - 2016 
°o IST, ATO 
Mass Manipulation/Locomotion (Gossamer structures, multi- 
segmented reflectors) 
° Driver — Advanced Observatories > 10 Meters 
° other— TRL6 - 2020 
°o IST, ATO 
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— Inspection (internal and external) 


° Visual and non-visual inspection through cameras, laser range 
images, hydrazine sniffers, leak detectors, etc.. on free flyers, 
manipulator end effectors, climbing robots. Looking for 
micrometeoroid damage, launch damage. Part of this done 
manually from the ground and on orbit. Need to increase precision 
and automation. (some risk) 


— Access for Inspection 


° The ability to remove protective coverings to gain entry for 
inspection: panels, blankets. The ability to inspect in hard to reach 
areas: inside nozzles, along radiators. (moderate risk) 


— Connecting (Align, mate, verify, all power, fluid systems not just 
docking) 
° Currently crew goes out and makes a significant portion of power, 
fluid, communication connections after arms dock modules. Future 


robots/vehicles should provide this capability for unmanned 
assembly prior to crew arrival. (some risk) 
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— Dexterous Manipulation/Human Interface Manipulation 


° Future vehicles for the moon will be complex modular, 
reconfigurable systems. A high level of dexterity in both 
manipulator arms and hands will be needed to efficiently work with 
these vehicles. (moderate risk) 


° All lunar vehicles that require maintenance will require human 
interfaces or special tooling to interface with robotic interfaces. 
Human rated interface manipulation would eliminate the need for 
both robot and human interfaces and special tooling to make 
robotic interfaces compatible with EVA gloves. (high risk) 


— Staging (Protection Removal, Temporary Stowage, Connector 
removal, etc...) 


o Space Station planned robotic maintenance is limited to removal 
and replacement of boxes with robotic interfaces. A future 
capability will incorporate removal of numerous parts, ordering, 
temporary stowage, part preparation for removal and insertion, 
etc.... Robots need this capability to off-load crew. (high risk) 


— Mass Manipulation/Locomotion (Gossamer structures, multi- 
segmented reflectors) 
° Observatories with large than 10 meter mirrors can not be launched 
in a single vehicle. A manipulation system that will apply minimal 
loads during assembly and maintenace is required for these 
unmanned systems. (high risk 7 
Pre-decisional Draft a 
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Mass Manipulation/Locomotion for Gossamer Structures Activities 


¢ Future observatories will employ gossamer structures to achieve maximum aperture size 
for minimum weight. To achieve this goal a new class of robots is needed that can move 
across light and fragile structures while imparting minimal loads that may need to be 
significantly less than those an EVA astronaut would apply during climbing. This 
breakthrough class of robots will transport the materials for construction, and provide 
assembly and maintenance capabilities. Multi-legged systems that can distribute loads 
widely over a structure and minimize forces during motion are a prime candidate for 
achieving this capability. Efficient free fliers are a secondary candidate. 


Space Suit Level Human Dexterity 


¢ Removing the barrier between tasks performed by suited crew and robots will provide an 
immense cost savings by eliminating the need to provide a separate set of tooling for both 
robots and suited humans. In-Space operations will change dramatically as robots with 
human level dexterity “earn their stripes” by performing as assistants during EVA in-space 
operations. The percentage of robotic maintenance tasks currently limited to 50% on space 
station will grow substantially allowing crew to spend more time exploring and performing 
science. Human level dexterity will be achieved through a system level approach that 
combines multi-fingered hands integrated with a manipulator system constructed to 
provide the dexterous envelope than an astronaut can achieve through entire body motion. 
In addition, sensing used by both the robot’s automated control routines and tele-operators 
will provide the necessary feedback to maintain proper force levels during dexterous 
operations. 
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Capability 


Structural Inspection 
(Needs More Automation) 


Inspection Access 


System Failure 
Inspection/Detection 
(cross cutting but included 
for discussion) 


Robotic Connecting 


Dexterous Manipulation 
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Technology 


Free Flyers 
Climbers/Crawlers 
Machine Vision 
Manipulators 


Dexterous Robotic Arms 
Dexterous End Effectors 
Specialized End 
Effectors 

Robotic Bore Scopes 


Machine Vision/imagine 
analysis 

Fluid Detection: Oxygen 
Hydrazine, Ammonia 
Radiation Detection 
Plasma Detection 


Specialized End effectors 
Multi-fingered Hands 
Force Control 


Small high DOF arms 
Multi-fingered Hands 
Force Control 
Proximity/Tactile Sensing 


Current 
CRL 


3-7 


2-3 


4-6 


Required 
CRL 


6 
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Driver Need 

Date 
Spiral 1 —- CEV 2009 
LEO 


Spiral 1 — CEV 2009 
LEO 


Spiral 1 — CEV 2009 
LEO 


Spiral 2 — CEV 2010 
LLO and EVA 
lunar surface 


Spiral 2 — CEV 2010 
LLO and EVA 
lunar surface 
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Capability 


Staging — maintenance 


Human Rated Interface 
Manipulation 


Mass Manipulation (Large) 
(SSRMS Proven) 


Mass Manipulation (Gossamer 
Structures) 
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Technology 


Small High DOF arms 
RF ID-Tags 

Machine Vision 

End Effectors/Hands 


Small high DOF arms 
Multi-fingered Hands 
Force Control 
Proximity/Tactile 
Sensing 


Large Robotic Arms 
Free Flyers for Moving 
Mass 


Low Reaction Force 
Crawlers 


Maturity Level -— Capabilities for 10.7 
Robotics for In-S 


Current 
CRL 


4-6 


4-5 


2-7 
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Required Driver 


CRL 

6 SAFIR 
Telescope 

6 Spiral 2 — CEV 
LLO and EVA 
lunar surface 

6 Spiral 3/4 — 
LLO/ Mars 
Transit vehicles 

6 Observatories > 


10 meters 


Need 
Date 


2016 


2010 


2010 


2020 


Technology Components 


Free Flyers for Inspection Propulsion System 


Miniaturized Sensors 


Camera Calibration 
Object Recognition 
Pose Estimation 


Machine Vision beyond 
targets 


Low Backlash 
Actuators 


Climbers/Crawlers 


Small, Medium Sized 
Manipulators 


High Power Density 
Motors 

Miniature Motor Drivers 
Miniature Sensors 


Force Control Load Cells 


Pre-decisional Draft 


Candidates 


Rechargeable 
Propulsion, 
Docking 
System 
MEMS gyros 


Patterns 
Templates 
Templates 


Harmonic 
Drives 


Rare Earth 


Hybrids 
Optical 


6- Axis load 
cells 


Maturity Level - Technologies for 10.7 
Robotics for In-Space Operations 


Current 
TRL 


4-6 


oho 


4-9 


6-9 


4-9 


4-7 
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Key Gaps 


Integrated 
Ground/Flight 
Test 


Environmental 
Speed/Memory 
Robustness 


Packaging 


Packaging 


Packaging 
Packaging 


Temperature 
Compensation, 
Size 


Need 
Date 


2009 


2009 


2009 


2010 


2010 
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Technology 


Multi-Fingered Hands 


Proximity/Tactile Sensing 


Large Robotic Arms 


Free Flyers for Moving 


Large Mass 


Low Reaction Force 


Crawlers 
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Components 


Miniature High Output 
Actuators 


Miniature Sensors 


Proximity Sensors 


Low Backlash Gearbox 


Propulsion system 


Force Control 


Candidates 


Brushless DC 
Magnetic 
Shape 
Memory 

Hall Effect 


LEDs 


Large 
Harmonic 
Drives 


Stored Gas 


Damping 
Control 


Maturity Level - Technologies for 10.7 
Robotics for In-Space Operations 


Current 
TRL 


7-9 
2-3 


4-6 


4-6 
(9- smaller 
ones) 


4-7 
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Key Gaps 


Size 
Packaging 


Reliability 


Environmental 


scale 


efficiency 


Computational 
Capability 
Sensor 
Environmental 
Issues 


Need 
Date 


2010 


2010 


2015 


2015 


2020 
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Metric 


Time to Inspect CEV for 
external structural damage 


Time to Inspect CEV engine 
Nozzle 


Percentage of Robotic 
connector Mating for Lunar 
Vehicle 


Percentage of Robotic 
Maintenance on Lunar Vehicle 


Percentage of tools used by 
Robot and EVA 


Successful Robotic Telescope 
Repair 


Force Level while transversing 
a Gossamer structure 
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Metrics for 10.7 
Robotics for In-Space Operations 


Technology / 
Sub-Capability 


Autonomous Free Flyer/ 
Structural Inspection 


Tendril Robot/Inspection 
Access 


Specialized End 
Effector/ Assembly 
Connecting 


Multi-fingered 
Hands/Dexterous 
Manipulation 


Multi-fingered Hands/ 
Human-Robot Interface 
Commonality 


Dexterous Manipulators/ 
Maintenance Staging- 
Connecting 


Crawler robots/ Mass 
manipulation on 
Gossamer Structure 


Target Value 


2 hours 


1 hour 


80% 


90% 


95% 


<2N 
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Need Date 


2009 


2009 


2010 


2010 


2010 


2016 


2020 
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Introduction (Steve Zornetzer) 
Process, Mission Drivers, Deliverables, and Interfaces (James 
Crawford) 
Autonomy (James Crawford) 
— Crew-Centered and Remote Operations 
— Integrated Systems Health Management 
— Autonomous Vehicle Control 
— Autonomous Process Control 
Robotics (Paul Schenker) 
— Robotics for Solar System Exploration 
— Robotics for Lunar and Planetary Habitation 
— Robotics for In-Space Operations 


Computing Systems (Mike Lowry) 


Conclusion 
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Autonomy and Robotics 
Capability 10.8 
Computing Systems 
(Robust Software) 


NASA Co-Chair: Michael Lowry, Ames 
External Co-Chair: Michael Evangelist, CMU 


March 30, 2005 
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Capability 


Capability Summary 
Robust computing software that provides high assurance for space-based sysicin-ievel 
capabilities including command and control, science data handling, vehicle health 
management, and fault protection functions envisioned over the next 20 years. The 
purpose of the capability is to provide software mission assurance and cost-effective 
robust computing for the autonomy and robotic capabilities of the future. 


Benefits 

¢ High assurance: Enable reliability of software-based capabilities for NASA missions, particularly 
advanced autonomy and robotic capabilities. Residual design defects will be minimized, and 
computing systems will have the capability of recovering from hardware faults and software faults. 
Many error classes will be eliminated. 

* Cost-Effectiveness: methods for development and validation of aerospace software that minimize 
human labor. Architectures that facilitate adoption of commercial components where compatible 
with mission-critical assurance. 

¢ Sustainability: software systems that are maintainable over a mission lifecycle. Reuse of components 
across missions. Migration of software to new flight processors and avionics architectures as 
hardware technology improves. 

¢ Predictable Software Engineering: Software development for NASA space systems will be matured 
into an engineering discipline with a well-understood trade-space and trusted products. As early as 
mission trade studies, the trade-space of different software solutions on system-level functions will 
be capable of being analyzed. 
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Advanced testing and analytic tools that provide assurance better than 
hardware-in-the-loop (HIL) high-fidelity testbeds alone. 


> Advanced testing enables covering an order of magnitude more scenarios 
without increasing cost and human labor. 


> Analytic tools provide guaranteed assurance of absence of many error 
classes. 

V&V for Autonomy and Adaptive Systems 

> Methods that enable reliability for capability 10. 

Fault Tolerance for computing faults. 

> Smart redundancy, micro-rebooting, software-enabled radiation tolerance, 
fault containment, software fault recovery. 

Model-based software development. 


> Certifiable and automated software generation from engineering design models and 
requirement specifications. 


> Cost-effective maintenance, upgrade, and recertification. 


Predictive Models of software engineering components, methods, and 
technologies. 


State of Art Cy, 
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Commercial sector historically * 
stresses time-to-market and Capability 

capability over assurance. Many 

commercial software products 

are mature with only 

incremental feature upgrades. 

Large product distribution to sv 
amortize development costs. 
Assurance: statement coverage 


Reliability 
considered adequate for testing. 
Size: XP is about 40MSLOC 
NASA h ds i ting due t 
* Traditionally aerospace has stressed We as pacing needs In aerospace computing due to 


mission length, light-time delays, radiation, lower tolerance 
for risk. Autonomy and robotics will exceed the limits of 
traditional aerospace capabilities, but reliability cannot be 
compromised - it will need to be enhanced. Many NASA 
systems are one-offs. Size and other risk factors for the 
software implementing these capabilities is not known, part 
of the general problem of calibrating software and 
determining trade-space of solutions. 


assurance over cost. Many aerospace 

systems have limited distribution over which 

to amortize development costs. Productivity has 
held nearly constant - rising from 7 to 10 SLOC 
per person per day over last 20 years. 

Assurance: extensive branch/statement coverage, 
MC/DC required for commercial aerospace. 
Size: ISS is about 2MSLOC 


Pre-decisiond@l Natt SaaS 


Computing systems are the most cost-effective means of 
implementing a broad spectrum of mission capabilities, 

Hence over time, an increasing percentage and number 

of acrospace mission functions reside in computing systems, New 
capabilities for autonomy and robotics will accelerate this trend. 
(Gata from military derospace) 


 Fumctionadity in SW 
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However, without advances in software engineering for flight 
systems, these increasing capabilities come at a significant 
reliability risk, as well as increasing cost and schedule, 
Residual software defects increase faster than proportional to 
exponentially increasing size of code (due to supra-linear 
growth of maxdule-module interactions.) Mission assurance 1s 
risked unbess better mitigations are developed, New 
capabilities for autonomy and robotics especially require 
advances in high-as surance computing, (Date iv evrrapolated 
from COCOMO-based mode! calibrated to Mars misstons 
SLOC and mission faliures.) 

Cost and schedule for flight computing system development 
follow similar curves and are bottlenecks in mission projects, 
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Benefits 


F 
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The result is analogous to Moore's law: an exponentially 
increasing size of flight software systems as the capabilities 
embedded in aerospace computing systems are increased, (Ota is 
from NASA robote and manned mission flight software, by mission 
date. Progression is by start date of mission development.) 
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State of the Art 
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¢ Verification and validation of mission software is labor-intensive and expensive, typically 
accounting for 60% to 80% of overall development costs in mission-critical aerospace 
software. Validation bottleneck is scarcity of high-fidelity HIL test-stands. 


¢ Computing faults are pervasive in unmanned missions and space station. These are often 
of little consequence during non-critical mission phases, and typically fixed through reboot. 
However, there is no known method of finding only those types of errors that are mission- 
critical. Bleed-through of faults from non-mission critical components to critical 
components have caused mission failures. 


¢ Aerospace software development is expensive and labor-intensive to meet process-based 
assurance. 


¢ The superficial malleability of computing systems for implementing changing system 
requirements leads to addressing computing solutions late in the mission lifecycle - leading 
to assurance, cost, and schedule problems. 


¢ The tradespace for computing systems solutions - from radiation tolerance through 
software validation methods through architectures for real-time control - is not well 
understood. 
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Sy 10.8.1: Advanced testing & Analytic Assurance j + yo 
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¢ Advanced testing and analytic V&V methods that provide assurance 
better than hardware-in-the-loop (HIL) high-fidelity testbeds alone. 


Calibrated hierarchy of testbeds with accelerated, model-based 
testing. Massive simulations of critical mission phases such as 
precision EDL on accelerated software testbeds. 


Measurement and characterization of false negatives/false positives 
between HIL and software simulators& analysis tools to optimize 
use of HIL testbeds. 


Analytic tools that provide guaranteed assurance for specific error 
classes (memory out-of-bounds, race conditions, runtime errors, 
non-compliance with flight rules, etc.) 

Early lifecycle detection of errors through tool-based analysis at 
requirements and design level. 


10.8.2: V&V for Autonomy and Adaptive 
Systems 
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Verification 


Model j 
Symbolic 


Verification \ Model 


Specification J Checker 


Verification 


Trace j 


Pacing applications for 
autonomy V&V: ISRU, 
ISHM, robust execution, 
planning and scheduling, etc. 


Pacing applications for 
adaptive systems V&V:Mars 
airplane, aerobots, process control. 


Lyuponov stability analsysis, white-box monitoring of neural 
net during adaptation scenario simulation, monitoring of 
adaptation stability during run-time. 


Adaptive Control 
Desired Control 
——==> Ref Model i — 
Control - Pa 
Variable Adaptation Pa 
Definition (Neural Nets) ~“ 
Sensor, st J 


Data 


On-Board Mode 
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¢ New approaches to fault handling for both hardware (e.g., 
radiation) and software faults 


— Smart redundancy (pool of reconfigurable redundant 
computing resources) for effectiveness and weight/power. 


— Smart software failure detection 

— Software architectures for robust radiation tolerance. 

— In-situ diagnosis of computing faults 

— Firewalls between software at different levels of criticality 


— Recovery through micro-rebooting, automated work-arounds, 
automated synthesis of component replacements 


asa 10.8.4 : Model-Based Software | 
Development 
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NASA flight systems will be crossing the threshold where unaided 
labor-intensive development processes are not effective to achieve 
the capability and reliability required within constrained cost and 
schedule. 
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Capture of machine-analyzable and testable 
requirements. 

Design models close to engineering models used by 
sub-system, system, and SOS engineers. 

Largely automated code generation from design models 
and requirements with precise traceability to both. 
Increasing automation of verification, validation, and 
certification. 

Support for iterative development, with human effort no 
greater than scope of changes to requirements and 
design models. Automation of back-end of ‘V’. 


“205— 
—_= 
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Mission Needs (among many dimensions) Computing Solutions 
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Commercial 
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Autonomy Verification Methods 
And Tools 
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asa Requirements/Assumptions y. 
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Computing system capability benefits cut across NASA space missions, 
but technology advances are unlikely to be funded for specific missions. 


The primary driver is safety and mission assurance. 


Secondary drivers are development cost required to support previous 
and new mission functions, and computing throughput/storage. 


Capability development needs to be designed from the beginning to be 
used across many different missions to increase safety and decrease 
cost. 


Barriers to adoption of capabilities need to be addressed: 


- Capabilities need to be validated and evaluated against trade- 
space for mission design to reduce barrier to mission adoption. 


- Capabilities should be packaged as separably adoptable parts. 
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Capability 10.8 Computing Systems (Software) rip 


Roadmap 


} 
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10.8.4 Model-Based SE Development Model-based Automated Certification of — for SLOC 
autocoded software i 


Software development 


10x reduction for flight Recertification technology available 
Recertification costs TRL 6 for Spiral 2, Mars airplane 
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A Major Event / Accomplishment / Milestone Evoliitionary (TRL 6) 
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¢ 10.8.1 Advanced Testing and Analytical Tools 


10x number of scenarios that can be tested to same level of assurance as high-fidelity testbed 
at same cost. Example: 10,000 scenarios tested for Mars Sample Return Martian launch at cost 
of 1,000 scenarios on high-fidelity testbed. (Moderate risk) 


— Residual errors less than .1 per thousands source lines of code (KSLOC) (Moderate risk) 
o Driver: Mars Sample Return 
° CRL 7 date: 2010 
o Interfaces: 15-SEC/RA 


¢ 10.8.2 V&V for Autonomy and Adaptive Systems 


— V&V methods for robust execution (slight risk). 


o Driver: Lunar robotic sample return, 2011; all other complex science and exploration 
missions 


° CRL 7 date: 2009 

o Interfaces: 10.2 AR&C/ISHM, 10.3 AR&C/AVC, 10.4 AR&C/APC&EA 
— V&V methods for model-based diagnosis. (Moderate risk) 

o Driver:ESMD Spiral 1 

0 CRL 7 date: 2009+ 

o Interfaces: 10.2 AR&C/ISHM, 10.3 AR&C/AVC, 10.4 AR&C/APC&EA, System Engineering 
— V&V methods for adaptive control, with on-board monitoring. (Moderate risk) 

° Driver: Mars Airplane, Aerobots, Process Control 

0 CRL 7 date: 2015+ 

o Interfaces: 10.3 AR&C/AVC, 10.4 AR&C/APC&EA 
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e 10.8.3 Fault Tolerance 


— Software Fault Containment, Robustness for Computer Hardware Faults (Slight risk) 


° Driver: Spiral2&3, MSR 
° CRL7 date: 2010 : : 
° Interfaces: 15-SEC/RA, System Engineering, 10.x 


— Software Fault Recovery (Extensive risk) 


° Driver: Spiral 3&4, Europa Cryobot 
© CRL/7 date: 2015 
o Interfaces: 10.2 AR&C/ISHM 


¢ 10.8.4 Model-Based SW Development 


— Recertification costs reduced to $1000 per thousand source lines of code (KSLOC) (Moderate 
risk) 
° Driver: Spiral2&3 
° CRL 7 date: 2010 
o Interfaces: 15-SEC/RA 


¢ 10.8.5 Predictive Models of SW Engineering 


— Software costs and schedules predictable to within 20% error in 90% of missions (Moderate 
risk) 
° Driver: Spirals 2&3 
o CRL 7 date: 2010 
o Interfaces: 15-SEC/RA 
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Sub-Capability Technology Current CRL Required Driver Need Date 
CRL 
Automated/accelerated/ Test suite _ 4 6 MSR, 2010 
calibrated testing technology generation/monitoring Spiral 2 
3 Spiral 1/2 


: Calibration to HIL 
Analytic assurance 


Software Engineering JIT testbed, 4-5 6 Spiral 2 2009 
Technology Evaluation Testbeds_ | instrumentation 


Fault Tolerant hardware and Comp. Architect, 3-5 6 MSR, 2012 

software Spiral 2 

Certified automated SW esa re ; 

generation a Spiral 2 2009 

Maintainability& reusability Iterated develop. 2009 
Environments/tools 3 5 Spiral 2 

Precision recertification 2012 
Dependency 3 6 Spiral 2 
analysis, targeted 
Testing 
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Capability Need/Gap Assessment 
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Sub Capability 


Predictive Models 
of Software 
Engineering 


Variance between 
predicted metrics and 
actual metrics 
(parameterized by 
mission phase from trade 
studies through 
deployment). 


Software engineering 


architectures/methods/technologies 


are not considered until late in 
mission lifecycle. 


Familiarity of design team with past 


mission software engineering 
practices. 


Evaluation testbeds for software 
engineering technologies, to 
enable transition of new SW 
technologies to missions. 


Advanced Testing 
and Analysis tools 


Fault Tolerance 


V&V Autonomy 
and Adaptive 
Systems 


—_—_ Pre-decisional Draft : 


Residual defects 


Measurable assurance 


Computing fault tolerance 


Assurance for advanced 
autonomy, robotics, 
adaptive control 


Expensive and exhaustive testing 
on high-fidelity testbeds 


Human review with limited tool 
support (e.g., code scanners). 


Expensive low-level hardware 
redundancy. 
Coarse methods of fault tolerance. 


Demonstrations of model 
compliance for model-based 
autonomy, model-checking for 
robust execution, black-box 
monitoring of adaptive systems. 


Calibrated hierarchy of testbeds 
with accelerated, model-based 
testing. 


Analytic, tool-based approaches. 
Assurance based on solid 
engineering principles, validated 
by space-flight. 


Smart redundancy 
New approaches to fault handling 


for both hardware (e.g., radiation) 
and software faults. 


Model-validation, automated 
checking of robust execution 
systems, envelope and white box 
monitoring of adaptive systems 
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Sub Capability 
Model-Based Development cost per 
SW Development LOC/function 
Develop time (i.e., time 
elapsed from design to 


code) 
Model-Based Maintainability 
SW Development 

Reusability 

Recertification 


Capability Need/Gap Assessment 


Custom programming. 
7loc/developer/day 


V&V are bottlenecks in 
maintenance S even bug fixes 
are seen as risky. 

Estimated 25% reuse of MPF on 
MER. 

Full-up revalidation testing. 


Pleven Pics ob | Ome 


Product families 
Certified software generation from 
engineering models 


Tools and methods for iterated 
development that address V&V 
Lightweight architectures 


Targeted recertification testing 
through dependency analysis 
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Metrics 


Metric Benefit / 
Sub-Capability 


Predictable performance | High Assurance/ 
of Software Engineering Cost-effectiveness 
Technologies and 

Methods 


Residual defects per High Assurance 
KSLOC for flight software 


Measurable Assurance -_ | High Assurance 
% Error classes excluded 


SLOC /person/day Cost-effectiveness/ 
High Assurance 


Recertification cost per Sustainability 
KSLOC of system 


Maintenance cost - 
KSLOC maintained per Sustainability 
person 
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Anecdotal/ 
Qualitative 


0.5 to 2 


$10K 
(ISS) 


<1.2 
(Shuttle) 


Target 
Value 


+ 30% 


< 0.01 


> 90% 


>100 


<$1K 


> 100 


A 
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Need Date 


2014 


2012 


2016 


2012 


2012 


2014 
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Capability 10.9 
Flight Avionics 


Sub-Team Chair: Leon Alkalai, JPL 
Presenter: Leon Alkalai?, JPL 


Pre-decisional Draft 


216 
—_= 


Capability 10.9 
Flight Avionics 
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¢ This capability is to provide NASA missions with a standard set of hardware 
components that can be adapted and customized to fit mission-specific needs. 


— Flight Computers 


— Data Storage 
Volatile 
Nonvolatile 


— Interface/Buses (I/O) 
— Engineering Sensors 
— GN&C Sensors 


— Power management and distribution 


¢ Which of these sub-capabilities should be considered within 
AR&C? 
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Ss overview 


PRcensen F?iemsnsie Barerenve CBee 
¢ Introduction (Steve Zornetzer) 
¢ Process, Mission Drivers, Deliverables, and Interfaces (James 
Crawford) 
¢ Autonomy (James Crawford) 
— Crew-Centered and Remote Operations 
— Integrated Systems Health Management 
— Autonomous Vehicle Control 
— Autonomous Process Control 
¢ Robotics (Paul Schenker) 
— Robotics for Solar System Exploration 
— Robotics for Lunar and Planetary Habitation 
— Robotics for In-Space Operations 


¢ Computing Systems (Mike Lowry) 
¢ Conclusion 
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Driving 
Missions 


AR&C 
Capabilities 


10.1 Crew-Centered and 
Remote Operations 


10.2 Integrated System 
Health Management 


10.3 Autonomous Vehicle 
Control 


10.4 Autonomous Process 
Control 


10.5 Robotics for Solar 
System Exploration 


10.6 Robotics for Lunar 
and Planetary Hab. 


10.7 Robotics for In- 
Space Operation 


10.8 Computing 
Systems 
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Systems: 


Mars 
Exploration Phoenix 
Rovers 


Various 
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A Major Event / Accomplishment / Milestone 


Science 
Laboratory 
A 


Mixed- Mixed- 
Initiative Initiative 
Activity Activity Traverse 


Planning Planning & instr, 


(2012) 
LISA 


Multi- 
Platform 


Collab. & Lannche eo Long 
Control Rendezvous : 
& Docking : 


Enhancing/ 
Evolutionary 


Lunar ae 
_ Sample * 
Return : 


: In Space : 
Per K  : Inspection: 


: Testbed / 
H A : 


(2014) 
Spiral 1 
A 
5 Mars 4 


Human 
Robot 


Ready to Use 
(TRL 6) 


Spiral 2 


— Recert. 
? Cost < $1K 
; ‘Interaction: 
: Robotics i 
:& control : Cause : 
:for ISRU _: Analysis: 


De stave Robotics and Comautma a a 
Autonomous Systems, Robotics, 


and Computing [ ( 
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Autonomous Systems, Robotics, and Computing [ ( é 


Systems: Capability Roadmap 


(2018) 

SAFIR Prometheus Spiral 3 Titan Aerobot Planet Imager 

. x Aah A Europa Cryobot 
a Comet Sample : Spirais4a5 4 

Return : A : 


Driving 
Missions 


: Venus Aerobot - 


: 
. 


Mars Deep Drill : Mars Airplane 


. \ i : In Space Z 
In Space UAV Crew: : : 

0 d : Safe Assembl : 

g Connection : Aut. Centered :_ °° ~ ; embly =: Robust 
Os P Process : Mission :/impoint Aerial Small : Enhancements Aut. & 
SS rocess = Control for : | EDL Survey & : f 
= o Controlfor Nuclear : ops.:  : 5 ; Body Of all Fault 

s Drilling Reactors. : Prognostics "*™P'NS EDL :  Spirall-3 Recovery 


Capabilities 
10.1 Crew-Centered and 


Remote Operations 


10.2 Integrated System 
Health Management 


10.3 Autonomous Vehicle 
Control 


10.4 Autonomous Process a 


Control 


10.5 Robotics for Solar a 


System Exploration 


10.6 Robotics for Lunar a 


and Planetary Hab. 
10.7 Robotics for In- re ee. Les 
Space Operation 


10.8 Computing 
Systems 
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Breakthrough Capability Rollup : é, 


Capability 


Autonomy and control for deep drilling 
(10.4, 10.3, 10.5, and 10.2) 


Dependable, and affordable robotic in- 
orbit maintenance (10.7 and 10.3) 


Dependable and affordable robotic in- 
orbit assembly (10.7 and 10.3) 


Dependable autonomy for aerobots 
and sub-surface (10.4, 10.1, and 10.5) 


Surface mobility to cliffs and other 
current inaccessible sites (10.5). 


Largely automated CEV and habitat 
operations (10.1 and 10.2) 


Autonomous robotic surface 
construction and ISRU (10.6 and 10.4). 
ooo pinpoint landing 
10.3). 
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Enables 


Sub-surface search for evidence of 
life on Mars and Europa 


Instrument change-out and long 
term operation of observatories 


Large aperture telescopes, 
affordable human exploration 
beyond earth-moon neighborhood. 


Aerial Mars survey. Surface access 
on Titan. Search for evidence of 
life on Europa. 


Search for evidence of life on Mars 
in areas showing possible recent 
fluid flow 


Human exploration of Mars. 


Affordable human habitation on 
Moon and Mars. Robotic site 
preparation in advance of manned 
surface missions 
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sal Summary of Key Deliverables [ > 
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Mars SolarSys.Lunar Obs. Earth Sci. Sun-Earth Spiral 1 Spiral 2 Spiral 3 


10.1 Autonomous mission ops 
10.1 Multi-platform collaboration 
10.2 Root-cause analysis 

10.2 Prognostics 

10.3 Rendezvous and Docking 
10.3 Entry, descent, & landing 
10.4 Nuclear reactor control 
10.4 Sub-surface drilling 

10.5 Long traverse 

10.5 Aerial survey and sampling 
10.6 Human-robot interaction 
10.6 ISRU 

10.7 In-space inspection 

10.7 In-space connecting 

10.8 <.1 defect per K SLOC 


a 
10.8 Recert.< $1K perk SLOC |} 
SMD 


ca First [| Enabling 
os [| Enhancing 
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Conclusions 
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AR&C is heavily cross-cutting. Most capabilities are relevant to multiple missions and 
mission classes. In several cases, AR&C results will change theme roadmaps. 


In many cases AR&C is providing common control and execution software for hardware 
developed by other capability roadmaps. Close programmatic and technical collaboration is 
essential. 


Strategic needs differ from other areas: 
— Infrastructure needs for AR&C are modest. 


- Creating a talented and motivated workforce focused on NASA’s unique challenges is essential (and 
difficult when NASA’s R&D funding is unstable). 


- Additional focus on validation and verification of Autonomous and Robotic systems is also essential in 
order to enable mission infusion. 


Other government agencies (and private enterprise) have similar but distinct requirements. 
- Industry advances can be leveraged opportunistically but not assumed. 
— DoD advances should be leveraged in areas of overlap (e.g. machine vision and tele-robotics). 


NASA pacing challenges trace to three sources: 
- Extremely high dependability requirements for one-of-a kind systems 
- Communication latencies 
- Surface exploration of unknown and dynamic environments 
- Challenging manipulative tasks (in the presence of communications latencies) 
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Capability Roadmap Teams 


Capability NASA chair External chair 


High-Energy Power and Propulsion Joe Nainiger (GRC) Dr. Tom Hughes (Penn State Uni.) 
In-Space Transportation Paul McConnaughey (MSFC) Col. Joe Boyles (US Air Force SMC) 


Advanced Telescopes and Lee Feinberg (GSFC) Dr. Howard MacEwen (SRS Technologies) 
Observatories 


Communication and Navigation Bob Spearing (HQ/SOMD) Michael Regan (DoD) 


Robotic Access to Planetary Mark Adler (JPL) Dr. Robert Braun (Georgia Tech) 
Surfaces 


Human Planetary Landing Systems Robert Manning (JPL) Dr. Harrison Schmitt 
Human Health and Support Systems Dennis Grounds (JSC) Al Boehm (Ret, Hamilton-Sundstrand) 


Human Exploration Systems and Chris Culbert (JSC) Dr. Jeff Taylor (Uni. of Hawaii) 

Mobility 

Transformational Spaceport/Range Karen Poniatowski (HQ/SOMD) Gen. (Ret.) Jimmy Morrell 
Col. Dennis Hilley (OSD) 


Scientific Instruments/Sensors Rich Barney (GSFC) Dr. Maria Zuber (MIT) 
In Situ Resource Utilization Jerry Sanders (JSC) Dr. Mike Duke 
(Colorado School of Mines) 
Advanced Modeling, Simulation, Dr. Erik Antonsson (JPL) Dr. Tamas Gombosi 
Analysis (Uni. Of Michigan) 
Systems Engineering Cost/Risk Steve Cavanaugh (LaRC) Dr. Alan Wilhite (Georgia Institute of Technology) 
Analysis 


Nanotechnology Dr. Murray Hirschbein (HQ/ARMD) Dr. Dimitris Lagoudas 
and (Texas A&M) 


Dr. Minoo Dastoor (HQ/ESMD) 
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